Disrespectful?

My boyfriend and I have been having sex for awhile now. We've always been cautious. I'm on birth control, we use condoms and he pulls out. Anyway, after being on my birth control for a few months I had asked if he wanted to cum inside me even with a condom on just to see what it felt like, and he always said no because he was too scared. We started having sex without condoms (only sometimes) since I'm still on birth control and he pulls out but the other day I was riding him and when we were finished I asked if he came and he was like "yeah, a little bit ago." I asked him if he came inside of me an he said yes. It kind of bothers me because he said he's been doing it for awhile. I think it's important that I know something like that. Right?