Relationship advice

My fiance and I have been arguing alot lately. He started a new job where he works 6-2 and most days I work 8-4. Well he never wants to see me or spend time together. We don't live with each other so that should mean he wants to see me. But he just tells it shouldn't matter if we see each other or not. But I don't know how to feel. We talked about it and I said how I felt but he just got mad and said it shouldn't matter if or when we see each other that doesn't mean we don't love each other. No I don't think he's cheating we are high school sweethearts. But I'm just confused. He said he's stressed because of the new job and family and what not. Any advice?