Am I wrong to be upset with him?!?!?

Need some quick and serious input!

I have been dating him for 3 years. I am currently 27 he is 35. We always seemed to be on the same page. I made it super clear right from the start that I don't date just for the sake of having a boyfriend. I date with the hopes of it turning into more because I want to be married one day and I want kids and I want a house with my future hubby etc. We have also spoken a lot about starting a family and getting married. Not necessarily tomorrow but in the near future.

Well he's been talking recently about wanting to move in together. And I'm thinking ok great maybe this is us moving closer to the point of marriage one day right?

Well today after church we had lunch and he brought it to my attention that he has no desire to get married and has for the very first time said to me he doesn't want kids. I was like why what changed your mind. He stated "I like my 2 kids. They're enough."

He has 2 kids from his previous marriage who are 13 and 16.

So I was like oh so you don't want to marry me or have kids with me? And he shrugged and said "No not really "

So I said he's totally allowed to have his opinion and such but I said to him I'm not moving in with you and he was bothered by it. I said I'm not going move in with someone who doesn't want to be with me in the long run.

Thoughts?