Baby fever!

So my boyfriend and I have been together for almost 7 months (talking since April). We hit it off right from the start and have barely gone a day without seeing each other since making our relationship official. We have talked about getting married, starting a family etc. I am beyond ready to start a family with him. I know that he is the one I want to spend the rest of my life with. Up until about 2 weeks ago certain things that are out of our control kept us from even being able to live together. Now we are able to and I’m going to be moving an hour away from my work, family and friends to be able to start our lives together and to have a family of our own. The other day we were having sex and I told him that he should cum in me. His response was “would you be mad if I didn’t?” So he didn’t. It hurt me because I’m giving up so much to help us move forward in our lives and I feel like he isn’t ready. What are your thoughts? Should I be upset?