Husband getting discouraged

A
We have been TTC since June . I am 26 and my husband is 30 and I would be lying if it wasn't get discouraging . I told him today that my af came three days early and for the first time since we have been practicing he told me he was upset and feels like it is something he is doing wrong . Mind you I was on bc for 10 yr straight so I told him that there could be many factors between the both of us . 
I guess my main question is what are some things that we could try to increase our chances of starting a family rather sooner then later