Boyfriend

My boyfriend told me a couple weeks ago that he wants to start a family. Then realized it isn't a good idea, we didn't try to get pregnant or anything but when I told him he almost looked disappointed and he said it's weird. I don't know what to do, it makes me so sad and almost uncomfortable. 
Does anyone else have this problem?