argument about going on vacation

my SO goes to panama city beach every other year around this time, I am 15 weeks pregnant i am showing anywho who would be going is my SO his sister her boyfriend his other sister her girlfriend and his mom i don't want to go for several reasons

im pregnant, me and his mom don't get along well at all, they all drink and will be drunk majority of time, ill miss my 3 year old daughter at home, I can't do most of the things they will be doing and I thought me and him being away from each other for a week will be good since im pretty annoyed with him for these last couple of weeks he is throwing a fit now because i don't want to go and he is sqying if i don't go he won't like Wtf am i wrong for not wanting wanting to go

?