No baby maybe?

I feel devistated. Me and my boyfriend talked about having a baby. i told him i either wanted him 100% sure about it. if not they we would use protection. i felt that way because his last daughter was conceived in a relationship that he was in that he wasnt sure if he did or didnt. he loves his daughter dont get me wrong but he was only with her for 4 months beforw she got pregnant. i think thats insane sense weve almost been together a year. same thing with his first daughter her mom was a booty call that turned into 7 and hald years and a beautiful little girl. i love both of his daughters very much. he told me he was 100% sure he wanted to have a baby with me. i spoke to my doctor because i do have a clotting disorder. Lupus anticoagulant. got diagnosised with it after several MC with my Ex Husband. My doctor prescribed me femera to get pregnant. sense i also dont ovulate regularly due to PCOS. Today i went and got the perscription. even told him i wanted him to fuck me really hard to possibly trick my period sense im 30 days late. He even agreed to it. well we sat down for dinner and he drops a bomb shell on me. He wants to not use the fertility drugs cause it gives us a good chance to get pregnant sooner. He told me we cant afford to have a baby. but that if i get pregnant then i get pregnant. He pays a lot in child support now that his second baby momma isnt working. i feel like im being punished for him getting someone else pregnant and because i have infertility he knows that me not on ferrtilitly meds will make it really hard for me to get pregnant. all i want with my partner is to have his baby and now its not going to happen.