College w/ SO

So this is a little rant I need to put out there.
So my SO is a six year senior at college, and I just graduated high school. I took the year off to figure out what I want to do and during this year off I met the love of my life. He's helped me figure out myself and I've learned so much about myself this last few months than I ever have my entire life. He's helped me learn what field I want to study in. And it turns out the college that best offers the field I've always dreamed of is the same college he goes to. 
He didn't purposefully try and bait me into going there, since he will be graduating soon. 
Anyway, I'm excited as hell to start college there. But I can't seem to tell any of my family or friends without them thinking I'm only going there for him. 
He won't even be in school once I start. Plus, even if he was still in school does it matter? I'm going for my own education, not to shack up with my boyfriend. 
It's irritating, and I just don't understand why going to the same school your SO goes to is such a bad thing.