I can’t help on who i love

Okay so I’m 18 and he is 41. We actually met when i was younger(16) but we agree that it’s wrong at that time. So we never did anything relationship wise. But anyway now we are together but it’s going down hill more then it can go up and we have two big things at make it harder. One: age gap and two: long distance. I love him but i never realized that as become more of a women that i would be working more while going to college. I currently have 3 jobs and each day i would tell him how was my day but it started that i would rant about my problems and didn’t get to ask him about his. And when i noticed it i would ask about his day first now and he would say it’s nothing or I’m fine. ( i know I’m going on and on about different things) so that lead us to fight and he telling me i need to find a kid to be with( my age) because I’m not the woman he needs. I feel bad about everything he said he should have stayed with his ex who was older but cheated on him . I love him and we are getting married (well he asked me to marry him ) but i thinks he wants to take it back. I’m just lost and hurt and just want some help.. what should i do. He tells me that all his family know of me but never sees me. I know his son and his son likes me. My family will disown me for this. And it’s just been days i would get into with my family and turn around and get into with him. I seriously don’t know what to do anymore.