Want to ttc...SO not ready

C
I am ready for a baby (and I've felt this way for a few years), but SO is not. I've tried to talk to him a few times, but he tries to end the conversation. He does want kids, but he doesn't want them now and he doesn't know when he will want them. If we were to accidentally concieve, I know he would end up being ok with it, but he is a nazi about condoms, so that's unlikely. We both have quite a bit of student loan debt, but by the time that's paid off we'll be old enough to be grandparents. I have endometriosis and the dr told me to start trying as soon as I felt comfortable and not to wait unnecessarily. It's not like we're too young or anything--he's in his mid-30s. Anyone else deal with a SO not being ready when you were? How did the two of you decide it was time?