Exploring Sexuality While Engaged

So, I'm bisexual. I've identified that way since I was 13. I've had one gf when I was 16 who I didn't really get to experiment with (she went down on me, that's it) not was I attracted to her. The entire time I was with her I only imagined myself with men. I thought maybe I'm straight. While single I started imagining being with men and women. I've now been with two men.

I have a child with the man I'm with now and I love him. For some reason it bothers me that I haven't got to be with a woman I was attracted more to and gone down on? My fiancè and I have talked about me exploring and he said it's okay but I feel that he doesn't actually want me to.

Is this feeling normal for bisexuals? Should I explore?