Should I message him?

I was talking to a guy I really got on well with started developing strong feelings for. We spoke on the phone all the time. We'd ring each other on our lunch breaks and in the evening and have such a laugh. But me being me and me used to being hurt I felt he was getting distant (it might've just been me) and j said he deserved better than someone who's insecure and has trust issues like me. I said this because 1. He has some sexual desires/fetish that I don't wanna really do (he likes dressing as a woman and having sex as one) and 2. He works with his ex of 4 years who cheated on him and they lived together. He said he has no feelings for her but I work every other weekend and he works Monday to Friday (both do long days) so I felt that he'd end up seeing more of his ex than he would me. Especially because he lives an 1 hour and a half drive from me and 1 hour train journey (I don't drive) so it's not like we could meet after work. I don't know whether to text him to talk it out and apologise for stopping this and not talking to him anymore or just to leave it. We spoke for 3 weeks and shared a lot about each other, we were open from the outset. he's a lovely guy but I just don't know what to do. If I text him do we just end up in the same position again or I text him and he doesn't want anything to do with me. Could we get together, months down the line he wants to live out his desires but I don't so he looks elsewhere? Or do I just leave it completely.