Stopped pill and i'm late

Cindy

So I stopped the pill about 6 weeks ago and I missed my period. It's about 2-3 weeks late. I'm 42 and not trying to get preg but my doc took me off bc because of my age. My husband would love another baby but I think I'm too old. The crazy twist is I also see an older man who used to be my boss and he refuses to use condoms. I've been seeing him without condoms about 6 years and he says there's no going back. In fact last time I met him I told him my period was late and he seemed aroused by the possibility and didn't pull out and even wanted to go twice! Sooo I finally took a pregnancy test and I'm NOT pregnant but the whole thing still has me rattled. And advice? And please save the lectures. I'm not ashamed of needing more than my husband can give.