Sometimes during sex...

Any one else's vaginal muscles push out their SO's penis? 
I don't know why, but sometimes during sex my hubby has trouble getting in because I push him out. 
Anyone else have this problem or is it just me?