My relationship won't work now

Me and my mom don't get on with my boyfriends mom (long story) I feel like this will destroy my relationship with him. I don't even want to go over and see his mom (I haven't for a while anyway due to her nasty personality towards me and my family)