I'm on birth control but my boyfriend...

Okay, so I'm on bc and I've never had problems in the past with pregnancy scares or pregnancies so I know it works well for me and I use it properly. Well my boyfriend has only ever finished in me once and then he got scared and got me plan b and I took it because it eased his nerves and the overload of hormones caused a yeast infection and he hasnt cum in me at all since, he always pulls out. I wish he would finish inside of me, but I feel like he just doesn't trust me to take my bc or something, I don't get it. But to me that's one of the most intimate things you can do during sex. Is it just me or has anyone else felt this way? I know he loves me but maybe he just worries TOO much..?