No intimacy since stopping birth control

So I've posted on here before about my husband not wanting to have sex since I got off the pill that was making me have PPD. Everyone said to talk to him and I have tried over and over and he keeps saying he's fine with condoms. We have had sex like twice in a month. He doesnt touch me anymore. He hasn't even slept in our bed in days which isnt like him. I just dont know what to do. Then I texted him after I went to bed explaining it to him again after I'd tried to be intimate on the couch. Then he comes into the bedroom way past the time I should be asleep trying to get it in. I told him that's not what I was trying to do and I just wanted him to talk to me. I said I dont want pity sex especially since he hasnt touched me at all in weeks and I need intimacy to want to have sex. And then he got shitty with me being mean and rude. Idk how I'm supposed to work this out when clearly things have changed but he denies it. I really dont want to get on birth control because I actually love my baby again and I'm afraid itll bring back my depression. I dont even know if that's his problem since he keeps denying it. I'm just so lonely. I'm sure people will somehow find a way to give me shit over this again but I dont have anyone else to talk to so whatever.