Worried my husband regrets having a baby... NEED ADVICE

Anytime my husband has to take care of the baby he gets so frustrated and fed up very easily. I.e if the baby is fussy when eating, or when the baby doesnt go to sleep right after his feed. He also sometimes makes comments that make me afraid he is going to get tired of being a father and or responsible for a baby.

Although when hes not having to take care of the baby he shows him some love...

In result I allowed him to only have to care for our baby 2x a day... & I'm becoming exhausted and somehow lonely.

Does anyone else's husband go through this? What should I do or say to help him stay positive?