Fear of Being Disappointed and Disappointing

I've been with my husband for 3 years and married for 8 months. We want to start trying this month. The issue is I don't want to be disappointed by others disappointment. My family isn't the biggest fan of him or our relationship. Recently my brother and I had a fight about it and of course he and his wife are pregnant. It's super tense between us and I can't even pretend to be happy for them. Everyone is so happy for them and I'm scared they won't be happy for me. My mom knows we're trying but she just doesn't talk to me about it. I'm so scared of being disappointed that part of me doesn't want to announce it when we do get pregnant. I just want to crawl into a hole and cry about it. It has me rethinking trying to have kids constantly. Does anyone else deal with the same thing? How do you deal with it?