Why is the Universe so unfair?

I am 20. He is 39. We've been together for over a year. 
I am in college
I live with my parents who hate him.
I am one skin color and he is the opposite - and because of his age and his color they despise him.
We see each other in secret. We can't spend more than 3 hours together...
I fear that as much as I love him, and as much as I want to gather my shit and make a life of my own, I will never be good enough for him.
I'm terrified that one day he'll get tired of this love and want to move on to something realistic.
A woman his age and a nice apartment with a good paying job.
I just want to know why my life is so unmatchable with his? 
I have everything except the standards
I'm funny and smart and one heck of a good woman who'd do anything for him. I work my ass off and try everyday to make it better than the last. 
We make each other happy, I just don't want it to end.