Feeling hopeless...

My periods come every three months and last anywhere from 12-17 days, sometimes longer. It took a year to get pregnant with my son who's now three and it's been over a year since I've gotten my birth control out. During this last period (around five weeks ago), my husband agreed to try for another baby. We decided we were going to try every other night so we wouldn't miss my ovulation no matter what day it fell on (since my periods are so irregular, it's impossible to track ovulation). Tonight, two and a half weeks into trying I told him I'm giving up and our son is going to be an only child. My husband hasn't been into trying. He's been brushing me off and acting like he's not interested in that part of me. I pointed that out and he told me he doesnt mind if we have another baby now, hes just not in the baby phase and doesn't want to try. I feel lied to. I feel hurt. I'm fighting back tears... What do I do?