Why is it so hard?!?!

I just don't understand why it's taking so long for me to get pregnant me and my SO are both healthy we're both at a healthy weight we neither one smoke I don't drink but he does occasionally nothing too crazy though we've even started eating a little bit healthier I haven't had any stress just taking it easy my periods are pretty regular either a day early or a day late we've been tracking my ovulation days it just seems like I can't get a break it just feels like I want something so bad but I can't have it this will make our 5th month TTC and I know A LOT of you have been trying longer than that I just can't help but feel so discouraged how do all of you handle this? Any advice I just feel so let down with myself