Confused

I’m currently 20 dating someone 25 years my senior and he really does make me happy. But all I ever get from people are negative comments. I just feel like I don’t deserve to be happy and I’m better of just disappearing. Opinions? :(