Sex while pregnant 🤰🏽

So as of right now I’m only 20 weeks and every time I have sex with my man it’s always fast paced and usually ends up to rough sex when you get farther along will it be a problem? I’ve talked to him about going slower and not always pounding away but he literally hates having sex like that I guess you can say he’s not the passionate type to make love 🙄and it never works he will go slow for a short time but then ends up pounding away 😑