Sex hurts now that I'm pregnant (tmi)

Is it normal for sex to hurt while pregnant? I'm almost 12 weeks and my sex drive took a steep dive once I got pregnant, so my SO and I have been going weeks in between each time. Today we went for it again and it felt like he couldn't fit in me... he's very well endowed so maybe that mixed with not being as active sexually caused the pain? Or is that something that happens while pregnant? (It only hurts for a few min, but it's each time now)