Am I being selfish?

I've been put on complete bed rest and the dr put me on disability for work. However, my question is, my in laws live 2 hours away from us and my husband wants to take our two children (2&4) for a few days. I haven't said no but the thought of not seeing my baby's for a few days is adding to the stress I already have. Am I being selfish by saying no?