Do I have a right?

My boyfriends family absolutely hates me due to our age gap which is 19 years apart. He’s older. We have a beautiful daughter together, I’ve been nothing but nice to his family & just trying to fit in with everyone. Well his mom told him recently that she isn’t coming to see our daughter as long as we are together, she also told him I wasn’t allowed to any holidays as well. It does hurt my feelings because I’ve done nothing wrong & have been absolutely amazing to my boyfriend. He’s upset & said throughout his years of dating his mom has never said she hasn’t liked any of his girlfriends. He said it’s making him question our relationship because he wants his family to be apart of our daughters life, but I told him if I’m not allowed to any family holidays then our daughter isn’t going either. I personally don’t think he should go as well because it isn’t right to leave me at home on the holidays when we should spend them as a family, no one should be left out. I’ve only met his mom 3 times & his family once which was last year at thanksgiving. They were all super sweet to me & then when I left I found out they were talking terrible about me. Do I have a right to deny our daughter going if my boyfriend decides to go?