Shouldn't pregnancy be a happy time?

My husband is stressing me out so bad. Im so scared that being upset all the time is hurting the baby. When i get upset and cry a lot, my belly hurts a little after. I'm just so worried and need support but don't feel like I have anyone to go to. Everyone just says, "Try not to stress, it's bad for the baby." Don't you think I know that?!? And not stressing is not as easy as people think. Just so sad and upset. Needed to vent.