Need some help trying to get rid of baby fever

My boyfriend listens to me 24/7 about my problems, needs, goals, everything. He cares about me ao much he'd honestly do anything for me.I love him to death as he loves me. we are at that stage and have been for a while where we talk about our future with our children. That is never a problem but I suffer from baby fever. He knows that I want a baby as does he but we both know that right now is not a good time for us to start our family. I try not to talk about it to him because he either A) tells me the same thing every time or B) I feel like imma scary him away with it. I know we are not financially stable, do not have our own home and since he is going to bootcamp soon for the military, why do I consistently want to have a baby? I am scared I am going to get to old and be in my mid 30s when we do try (theres nothing wrong with having a baby mid 30s just not for me). I wanna be surrounded by family and love. I feel like I am being selfish on the matter. i just want this emptiness of wanting one to go away. Please anyone give me some advice.