Too late to go on holiday?

Okay, I am almost 7 weeks pregnant, I haven't told my immediate family as of yet as we are waiting to see the doctor on Wednesday, but my step mother has just informed me she has booked us all to go on a family holiday for a week in May! We're not going abroad, just going somewhere else in the UK... 
​My baby is due on the 2nd of June, would it be too risky if I went with them on the 16th of May? :(