boy troubles!! help!!

So the guy that I've been talking to and sleeping with for the past month just joined a frat and I'm starting to feel like he doesn't like me even though every time I see him his face lights up and he always kisses me goodbye and he doesn't want a relationship right now but he doesn't want to talk to anyone else...the frat he joined is a super party frat and I'm worried that he's just going to drop me for a sorority girl any day now...should I break it off with him? I really like him but I'm going crazy trying to decide if he still wants to date me...he's not all about the sex either...we've had loads of dates that don't end in sex and when we do have sex we have this amazing connection that we both feel...help I don't know what to do