Would you let your babies dad take your baby over night? Please read first

I’m really stuck and need some advice. Me and my partner decided we were gonna live separately when our baby is born. I live kinda half and half. I’m fine with that because personally I think our relationship works better that way. My issue is I told him I didn’t want to stay at his house the first week after giving birth, I want to feel at home and be able to look after my self and the baby. I said I’d visit during the day but I want to be in my own bed. He’s asked me during that week if he can have our baby over night and I really don’t know how to feel about it? I understand he’s the dad and I may seem selfish to him but I can’t just do that and I have no idea how to explain it to him? Any advice? 🤔