Husband keeps asking me about jobs

So my husband keeps telling me that i need a career path and how i should have a 15 year plan. We both agreed when I was pregnant that my job is just taking care of the baby until she goes to kindergarten but now he keeps asking what im going to do when shes in school and how I need a plan for a career. My daughter is 3 months old, i think i have sometime, i dont think its a rush but he keeps pushing the subject. I start getting annoyed because shes only 3 months, i just finished university while 7 months pregnant and his job could move us in the next couple years so why would i set a plan if the plans going to change. Am i wrong to be irritated?