Moving in together?

I need some advice. My boyfriend and I have been dating since the summer after our freshmen year in high school 8/13/11. I recently moved 4 hours away, however I changed my major to a history teacher and am thinking about moving back to finish my degree at the community college in my home town to make my schooling more affordable. I was thinking if I moved back I might want to live on my own, so I asked my boyfriend of 3 years what he thought of getting a place together, all I got was silence and eventually he asked why I didn't wanna live at home. Should I be worried that he doesn't wanna live together after 3 years or am I moving too fast? Would love some opinions and advice  please and thank you!