HELP!!!!!

I was deciding whether or not to post this but I need help. My husband and I are trying to conceive. We have no problems in the bed room but I keep starting my period every month. We both want a child so desperately but it's starting to get upsetting. Every time I start he kind of pushes me away for a few days and I don't know what to do or say to him. I know it hurts him because having a baby with me is all he talks about. He is starting to think he is doing something wrong. And I'm starting to think I'm not very fertile. I just came off my birth control 4 months ago, I have been on birth control ever since my first period. Could that have caused problems? I know we haven't been trying very long but it's still upsetting.