Am I ungrateful?

Mrs.
Ok ladies I need some advice. My Husband and I just announced that we are expecting I'm 20 weeks. We avoided everyone for the past few months because we have had lots of miscarriages and didn't want to say anything until we felt safe. Anyway, so his cousin and mom came over for dinner. If you have read my post you know that I'm not a fan of his mother because she was very hurtful and judgmental when we first met and I just feel like she very phony and she can't get it through her head that her son is married and has his own life she very needy and I just don't trust her. His cousin is not a good person she talks about everyone and she's even told lies on me that she's unaware that I know about. They are both very phony. Anyway, Saturday they are both like oh we're going to do your baby shower. I'm like what? And I look at my husband because I don't want them doing anything of the sort. I rather do my baby shower myself if none of my actual family or friends don't volunteer. So later my husband asked me if I was ok with it I told him no. Because  be knows how his mom is she will make the whole thing about her and I don't want that. Then she will tell everyone that's in attendance how she did this and that. Am I being selfish? I was just under the impression that these kinds of things are planned by someone your close to. Not two people that you don't trust and really can't stand. Please help! Should I just let them or stand my ground my husband has my back and he knows how I feel about his mom and his cousin he even agrees with me but he doesn't want me to end up planning my own shower so he's willing to have them do it but I'm not.