no contractions but water breaks?

If there aren't any contractions, do you still go to labor and delivery after your water breaks?? For those that gave birth already, did you have contractions first or did your water break first? 
FTM here and officially 41 weeks tomorrow (ugh)!!!