long distance relationship and bad sex.

Since me and my boo was together for a 8 month and we live in different area of North Carolina. he live in Wilmington nc and I live in roanoke rapids nc(closer Virginia line). we had been video chat everyday and text and many way to keep contact. I am work as overnight and he work during first shift. It's way hard for us to stay up and keep contact each other. So, whenever I had day off work on weekend and we meet halfway to talk and shopping and out eat together. one night he and I made a love and i was so excite .All the sudden he went out and rolled bed fa sleep. I was like what the heck was happen. we had a barely see each other in person. So, we try again to have a sex then he went the same thing again. I was like should I give up on him because of the sex or should I stay with him and talk to him about the sex. Men don't like discuss about the sex issues. Please help me what should I do ?