Would you be mad? Am I being crazy?

Back history.

I met this guy at work (April 2018) we hit it off INSTANTLY!!! Super funny, sweet, made me laugh and smile he seriously was perfect. I noticed he didn’t have a ring, as he is a much older man... he tells me their separated”, and working on filing for divorce.

They don’t live together, so I believed it.

We start hanging out everything’s good fast forward—————— we be been officially dating since May-Juneish... we go out to dinner, people at work know, met his kids, his dad. Other things. He leaves his phone home... I’m not one to snoop but I felt the urge to today for some reason, (we have been having less sex than normal, he says he’s too tired... but idk) honestly she’s never given me a reason not to trust him. I just had a gut gut feeling. So I’m looking through the phone... (mind you he had a face lock but doesn’t know I know his code to get in) I see a text message from his ex wife.. she texts him on New Year’s Day, confronting him about his “new young shinny girlfriend”... his response. “Girlfriend? Hardly” I DONT KNOW HOW I SHOULD FEEL ABOUT THIS 😳🥺 I don’t know if he said it because he doesn’t want drama with her, as he still has some belongings they were officially divorced until October. I mean, if I’m hardly a girlfriend then what is this?! I stay with him every night, weekends he stays with me. He’s about to drop money and buy me new tires.. should I say something? Should I just not worry about it. We’ve been good no drama no issues. I’m super happy. But idk what to think of this.