Confused

So there's this guy I met my first semester of college who I lost my virginity to. Who I've liked since the first time I seen him. We've honestly been through it all this semester and we were constantly fighting over a bunch of stuff. Anyways the end of the year came and he told his roommate who told me that he feels really bad the way he treated me first semester and that he thinks he might love me. So then the two of us sat down and had a conversation where he told me he likes me just as much as I like him maybe more but he's not good with showing his emotions and feelings. He does this weird thing where after we have sex he doesn't talk to me for a couple days. My roommate thinks it's because he doesn't know how to act around me..I can feel that he does like me but every time I try to bring up communicating with me he kinda shuts it down. The only way I hear about how he's feeling is from my friends. Now we're on summer break and we live in two different states so he face times me about once a week. Do you guys think he's even worth my time. I think I love him but I'm not putting myself through all of this next semester when school starts..because my grades suffered because of the stress he put me through.