Newborn and kids birthday party

My friends are having a party for their 3 year old daughter. I have a 3 week old infant, should we go with the baby? I’m exclusively breastfeeding so I’m not ready to leave her with anyone yet and go somewhere without her. I lm a little paranoid about being around a bunch of kids and and if someone is sick. I haven’t really been out of the house since she has been born so I’m having a bit of cabin fever as well so I’m thinking of going but want to be sure it’s the right decision.