Am I in the wrong?

I just came home from the hospital with my newborn baby. I spent 36 hours in labor and another 6 hours pushing. I gave birth to a beautiful 9 pounds 2 ounces little boy. My miracle baby. After he was born his bloodwork came back that he might have a slight infection so we stayed in the hospital for a few days. I was in the hospital for a total of 6 days. I've only been home 2 days. My fiances parents are pushing to come over and I want them to wait a week so we can settle in and so i can recover. Well he said they could come visit today and I'm really upset about it. My finance is mad at me for getting upset about them coming over when I asked for more time and said it was too soon. Am i in the wrong here?