Overnights already??

The father of my child and I split before she was born, she is now 2 weeks old. He wasn’t around much of the pregnancy and got back with his previous girlfriend who he shares a child with. He was present for the birth and was up at the hospital every day we were there. He came to my house a few times but then his girlfriend started complaining about it and he hasn’t seen my daughter in about a week. He texted me yesterday and asked if he could come see her and I said yes but he never showed up. Today, he texted me and asked if he could have her overnight and I told him no that neither her or I were ready for it and said he was more than welcome to come over for a few hours or sleep on the couch in my house if he wanted. He then told me I was being selfish. I breastfeed her but I pump and give it to her in a bottle. Do you think I’m being selfish? Would you let your 2 week old stay at her dads??