I love my partner but I just feel like our relationship isn't making much progress.

I have been in a long distance relationship for 4 years now. I go to school full-time and have a part-time job. Ever since I have dated him, he hasn't had a job or gotten a job and 1 1/2 years into college he was placed on academic suspension (which he did not tell me until 3 years in our relationship -_-, he just told me he needed a break from college to figure what to major in; which is understandable...) He is planning on going back to college this Fall but hates sharing and asking me for help. He feels I deserve the best of him meaning he won't accept my help. I only found out through a good friend of his that he was applying back to college. I was very sad because my boyfriend didn't share the news with me myself. 
I guess I'm just upset that he isn't worried about our future together. We don't see each other often because it gets complicated and spendy, especially since he needs a place to stay whenever he visits. Every time I mention anything about school or finding a job, he tells me not to worry about it. He tells me the more I nag him the more it makes him not want to do it. His only income right now is from babysitting his nephews and nieces. 
I recently just turned 21, and he didn't do anything to celebrate my birthday. Yes, it's fine but I guess I was expecting something small at least but half of me thinks I'm too selfish because it's a long distance and my birthday was on a weekday. He just turned 23, I got him a pair of Jordan's (1 pair) as a gift for Christmas, his golden birthday, and our 4 year anniversary. Don't get me wrong, he bought me gifts for Christmas but I was just expecting more, especially for our 4 years in Feb. 
Am I being selfish? Too materialistic? 
I just recently brought up the idea of moving in together since I have 1 1/2 of college left...and he was very shocked. He said he never have thought about living together. This was suppose to be a hint on, "find a job so that we can start our life together!" But sadly he didn't quite get it. I live with my parents and he lives with his older brother. 
I suppose we just have different goals in life, and are very different people. And I don't know how to feel, maybe distance is testing the both of us. :/
Any comments or advice would be appreciated. 
* sorry for the long post.