College and relationship

Hi, my boyfriend and I are getting ready to start college soon and we've been dating for around two years now. We love each other dearly but I'm scared that during college we'll drift apart. We're used to seeing each other 5 days a week since we went to high school together and had classes together and I didn't have a job at that time. Now we both have jobs and have classes on different days and I'm just scared that since we'll hardly be talking because of conflicting schedules that we'll just drift apart and break up. We've been talking about this recently and he's not worried about it, which is definitely a good thing, but I dont know how to calm my anxiety over it. Any advice? As of now we're able to go out maybe once a week for a few hours if we have the money to go out and do something and if we're not stuck studying or doing homework. I know that we'll have to fight harder to get through this, but I'd really appreciate some help from others who have gone through this! Thanks in advance!