Its only three days...

So my boyfriend and I have been together for quite some time now (2 years.)
As you all know Easter is around the corner! 
My close family (Mom, Grandmother, Grandfather) and I planned a beach trip leaving april 13 and coming home april 16. We're a 5 hour drive from the beach. Hes used to being aroud and loves my family.
The 16th is Easter.
My boyfriend's family always has an Easter dinner around 12pm.. but its not like we couldnt be back around that time.
That being said, my boyfriend refuses to go with me in fear of what his mother will say.
Thoughts?