Am I doing the right thing for my son?

Nia

Hello everyone. I need some advice. My little one will be 6 weeks old on Wednesday. Since then his father has only seen him twice. The father and I are not in a relationship and we are not on good terms, but I have never kept him from seeing or being in contact with his son. He hasn’t given me anything for him and yesterday was the first time he asked if the baby needed anything. Today he said he wanted to come see him multiple times this week and I told him no because I won’t allow him to come in and out his son’s life and only show up when it’s convenient for him, was I wrong this?