Traveling without kids

I won tickets to the Ellen Show. My husband, best friend, and brother are going with us. We would be leaving on 4/2 (in the evening) and returning on 4/5 in the afternoon. I have a 7 year old and a 7 month old. I am having a really hard time leaving the boys and can feel my anxiety ramping up. My husband says we do need the time alone as we are generally always with the kids but we both work so I feel like I don’t get a lot of time with them either. How do I handle this? Do I cancel the trip? What do I do?