Husband wants to try for a baby in August

Last night my husband said that he wanted to try for a baby in August. I am a school teacher and this will mean that I would be due in May (if it happens in August) and I would miss testing my kids, and closing down my classroom. I suffer from anxiety and OCD and when he said it last night, I was okay with it but this morning I am freaking out. We are tried to our bills, I can't leave my students at the most important time, and I don't want anyone closing down my room but me. I don't know if it's the anxiety or what. I just feel I want other things before a baby, like a house we own, a camper to go camping with dogs, and starting my masters degree. Is it wrong of me to feel this way to be this selfish of the things I want instead of a baby right now?