Am I Bisexual? Do I tell my boyfriend?

I'm female, 16 and I recently have began thinking maybe I might me bisexual, I think girls are attractive and often thought about girls sexually before getting with my boyfriend. I asked him the other day how would he react if I came out as bisexual as if I was joking and he replied with "I'd be upset, I don't know I think I'd break up with you" I was heartbroken and even though I'm not sure if I am Bi I'm now worried he won't accept me. What should I do?