no sex in a relationship?

Me and my partner agreed and decided to have baby number 2 before our daughter was 2 not having much longer to go.. 
I looked up how to most likely have a baby and it said to have sex pretty much everyday. Problem is I already struggled enough to get my partner to have sex with me in the first place. So I thought if I told him before hand it would be easier so now he has said I'm not spontaneous enough and it's awkward cause I tell him and I explained to him he never wanted to before we agreed to this (I would try To seduce him but nothing came out of it and if I give him little hints he would pretty much shut me down) So I just said we will stop trying and we won't try for another baby we already have 1
but now I'm scared.. 
I was very insecure with him not wanting to before and it effects my anxiety greatly(he isn't the reason for my anxiety I'm not saying that) and I honestly just feel like giving up completely I'm just not sexy anymore. And I haven't had an orgasm in probably a year and I'm just confused upset and having no damn idea what to do