What to do?

This may be a stupid question but I was dating a guy and we lived together for 3 years. He became very controlling and emotionally abusive. I finally had enough and packed my stuff up and moved home. At the time he told his friends and family it was me and made up some lies. It’s been 8 weeks I do miss my only bestfriend but he says he loves me just don’t know how to fix it with his family and friends! I am 41 he is 49. He wants me to sneak to his house 2 or 3 times a week and have sex and go out and do normal things but we can’t be seen by them. He goes and has fun with his friends on the weekend but doesn’t want me to leave the house or talk to anyone or try dating someone else. I feel like I’m wasting my time. Do I just give up and move on and leave our friendship just move on completely? It hurts to think I won’t see him ever again but hurts more when he tells me to get over it and deal with it! I’m not getting any younger!