Am i wrong?

So my son is almost 2. I’ve done everything myself since the day i found out i was pregnant. His dad got him a couple outfits, like 3 small packs of diapers, and 3 small packs of wipes. Also like 2 cans of formula when he was little but come to find out his other baby mom bought as well as she claims on buying mostly everything he’s handed over to me. If we aren’t on good terms, he’ll go weeks, sometimes a month or so without asking how our son is doing or try to see him. He went to jail for 3 months and came out trying so hard to make our family work. Dumb me gave in and even when we were living together, i still did everything alone. I still bought everything our son needed. He never offered to pay or chip in or asked if he needed anything. After about 4 months, things fell apart. I left bc he was basically cheating with his other baby mom. Since then (December) he’s seen our son maybe 2 times, once when he stopped by for 10 minuets after his probation appointment, and once when i drove 2 hours to stay two nights to let them see each other. Since then he hasn’t asked about him at all. I posted a pic of my son in the hospital saying get better baby, he’s not my friend on Facebook but his mom is, and she liked and commented and definitely told him bc she tells him everything. Never got a text about what’s wrong, is he okay, nothing. Then i find out his other son needed surgery and he made up an excuse not to show up once while he was in the hospital or soon after coming home. He sleeps on a mattress on the floor, they (him and his mother) don’t own a vacuum so the floor is disgusting there’s crumbs and a whole bunch of stuff on the floor bc it never has been cleaned (since the first week of December) not that long ago he told me they found a mouse and they have no idea where it went, there’s never food in the house and his mom will leave food out like meat over night and cook it the NEXT night while it sits in the sink all day. I don’t want my child eating bad food, not having anything to eat, and being in a dirty house. If he were to ask for our son, would i be wrong to say no? He’s two hours away and my son barley even knows him and i don’t like his living conditions at all and don’t want my child there. When we were on good terms I’ve been on FaceTime with him while he had his other son and he wasn’t even watching him. He was too into his phone and i asked where the baby went and he goes idk out in the living room he’s okay (his mom is always in her room with the door closed and the house is not baby proof at all) also, he always used to go out and get drunk or drink like 12 beers at home while he had his other son and he doesn’t get him often. Really? You can’t wait until he goes home? You don’t have him every day. He makes his mom watch him so he can go to bars and party.

I just don’t want to get into legal trouble if he tried. He also has a daughter who is almost 3 and once the mother stopped talking to him he fought for custody after a year but only stuck to it for a month. He hasn’t seen her in over a year now. So i don’t think he’ll actually go to court, he’s also super broke. But i just want to know what i could be getting myself into if i were to say no.