Feeling emotional

My boyfriend and I have been together for three years. I thought we had decided to try for a baby. He seemed like he was fine with it. But now he woul rather hang out on his own eat meals in separate rooms. We used to do everything together I'm 31 he is 35 and we're not married yet he hasn't even thought about that. Should I worry.