boyfriend help.

I'm in college and my boyfriend is a farmer. This makes things a little difficult because he is up early and then goes to bed early. Either he's working or I'm in class and we never seem to find the time to talk. I feel us drifting apart and I'm a little scared because I don't want to lose him. Should I just ignore this and play it off as me being insecure and panicky?