I want to know if I'm Bi but i have a boyfriend.

My boyfriend and I are in an amazing relationship. But even before him and my ex, I have always thought fondly of women. But really only in sexual ways even tho I have met women that I kind of felt strongly towards in more of a loving sense. But I have only dated men. My boyfriend and I were thinking about it and was considering letting me kind of have an experience with a woman.

I just wanted to know other peoples thoughts on this. He is really hesitant about it which is absolutely reasonable I mean him and I want a future together. But what do you all think? Like I really really want to know. But I want him to be okay with it.