When to give up ttc?

I’m 34 have two boys 9 and 14 with my ex husband been trying to conceive for 3 years with my boyfriend. When do we say enough trying and just give up? I feel like every month is going to be “the month” but then my af shows up and I literally cry. He says he wants a baby but I don’t think that’s true. He’s my age just bought a brand new car loves to race and everything car related or his dogs.