Being pregnant

Confused so my husband and I have 5 kids total together 2 our mine from a previous relationship and 2 are his then we have 1 together ...... We ve been trying to get pregnant and now that I m pregnant it seems to feel weird to me like he's my happy maybe it's me. But before I knew I was pregnant we drank a lot maybe like 3 times a week. Well I never knew I was pregnant while drinking because I still have no symptoms well last night I asked him do u not wanna have a baby anymore and he said it's not that he said he's worried that something could be wrong with the baby. I m not sure how to feel I honestly feel confused