Is this wrong??

I am 20 and the man I am seeing/I am into or falling for whateved you would like to call it is 24 years older than me..he’s 44. I know this may sound really bad but ive known him since I was 16 we’ve always been super good friends back before I was an adult we never did anything I swear on my life. He was a super good man, he knew I was into him but he kept his distance because he knew it was wrong. We decided To stay friends so maybe one day we could work things out and I’m glad we did, he still makes me happy as can be after 4 years of us knowing each other...I’ve never had someone make me smile like he does or make me laugh like he does. Hearing his voice still lights up my whole day, seeing him makes me happy as can be and I could never ask for more. We get along better than me and any one ive ever known in my life gets along honestly its incredible. I mean yes we’ve had our moments I mean every one does but we get past them and come out better than before. Everyone looks down at this because of the age difference and I just wanted to know how bad it truly was. I mean I just want an honest opinion, how bad is it really??