Need help! Father wants visitation overnight!

Okay so my son will be 2 months old on the 7th. His father now says he wants to get him by himself now or he won't see him at all due to his hatred for me. His name is not on the birth certificate and he's only spent time with him maybe a combined total of 3 weeks (not consecutively). I'm not ready for him to go off by himself. I know this will likely result in him getting a court order. Problem is while pregnant after we broke up I was still living with him but had severe anxiety/depression (wasn't diagnosed bc wasn't open with dr) and had episodes where I would get so upset with him I would hit my head against the wall or cut myself. Well he recorded some of my episodes that occurred. Well he was also on crack (pretty sure he still is ) and I have pictures of him smoking it. What can I do to keep his visitation as him seeing the child with me present only. Bc I don't think it's a good idea for him to stay with his father considering he barely knows him and considering his history!