I’m concerned...

I’ve only had sex a few times but with only two different people. However every time no matter who it was it wasn’t super painful but there’s always pain at first..? I’m very tight and while guys say they like that, I don’t. I mean I don’t wanna be loose or anything but my ex was happy at first and then got irritated because it would take a while for him to fit. And both my ex and my current boyfriend aren’t huge or anything. I’m not sure if I’m not wet enough or if I should be more concerned and see a doctor. It’s much easier with my current boyfriend but I can’t tell if it’s because it’s more passionate and sexy or if it’s because he’s smaller (5-6 inches). Should I see a doctor or try other methods?