Wanting a baby, but..

I have mentioned it to my boyfriend that I want a baby several times, but everytime he always says 'Maybe one day.' But he makes me feel like he doesn't want a family with me.. How should I sit down and be serious with him about it?