Pushing too hard

Hi ladies! I am experiencing constipation and although I know this question had probably been asked a million times, I would still like some nice reassurance haha. Aside from being painful for me and possible hemorrhoids, pushing too hard won’t hurt the baby right? I just had a hard time in the bathroom right now and strained harder than usual and of course it worried me because of my little lady in there. First baby and 26 weeks gone!