Does it make sense

My husband and I have been ttc for four months now, it's been stressful to say the least so far and with a new move and new jobs we have been a bit off and arguing frequently nothing drastic but I figured we would just take a break from trying with us being a little rocky (we are certainly not anywhere near splitting in case anyone might think that) my husband is gone for work a lot and he just came back this week, I usually let him know all my fertile days but haven't been keep track anywhere near normal just I'm generally aware of my fertile times. It seems like I have been a little emotional and on his nerves lately so I was surprised this weekend when he didn't use the POM. It is my fertile week and I'm happy. But does it make sense to keep trying while we aren't in the best place relationship wise? Or is it fine since we both know it's ultimately what we want? Thoughts?