Unsure of the future

Sammy

So, I've been dating this guy since june. I'm 33, hes 29. We met online and hit it off straight away. We speak every day on the phone for hours. I finally plucked up the courage to meet him a month after we started talking. We get on so well (especially in the bedroom) and enjoy each others company. We live about 2hrs drive apart so only see each other once a week where I stay over 1/2 nights at a time. All is great.. except one big thing. We come from very different walks of life. I've always been very cautious with money. Hes in a lot of debt, to the point debt collectors turned up at his flat to take his stuff. I dont want to be involved, and having that coming to my door. My upbringing has been a lot different to his and I'm not sure in the future this would work. He stays at home all day smoking weed, unemployed, doing nothing pretty much. I work full time and have my own place I have bought. He lives in a council flat in a high rise tower block which without sounding bad, is quite disgusting (mould and damp). I just cant see myself having that life. The way he disciplines his 9yr old is terrible in my eyes, swearing and shouting at him alot etc which is not how I would deal with things. I barely swear at all, let alone to a child. But take all that out of the equation, we work so well together and I feel silly to give that up. I have really strong feelings for him. I just dont even know how I'd be able to introduce him to my family and friends right now with the situation hes in. Am I being a selfish for wanting more for my life than that? Opinions?