I NEED OPINIONS PLEASE

So today I am on cycle day 3, I started 1st dose of clomid yesterday. But hubby said he’s not ready and wanted to take a break of ttc. And I respect him and I also feel like we should actually take a break.

My question is now should I continue the clomid? Cos I have 4 doses left. Or should I just stop? I need opinions please thank you