HELP idk how to feel

I am 23 years old and me and my partner have been ttc for 2 years now.well i get pregnant but never hold past 4 months well after plenty of test of all kind dr came to i dont make enough of a hormone. needed when pregnant ok easy fix he said a pill will be giving once i get pregnant agin for the first 14 weeks...GREAT well now here is the pisser off my man wont stop pulling out now like he has givin up right now on wanting a baby with me....mind u every miscarriage was hard for us both but the last all blame was put on me and hurtful things where said .i lost alot of weight from my last pregnancy and more so depression after my misscarriage im tryimg to get back right but his actions are killimg me idk what to think. should i just give him time