I’m in the wrong but I need advice!

I had the marriage and baby talk with my man and he basically told me that he doesn’t feel the same and that’s not what he wants right now at all. Well I was upset and went to bed after that. The next day he just text me and said he wanted to be sure we were on the same page and that he didn’t mean to say he didn’t want those things with me. He said that he really does want that with me but he can’t afford it right now and wanted to make sure I knew that. But now I’m just grumpy with him. I don’t know why but I just feel agitated and annoyed with him. I don’t know if i just need some time to process this because I was so excited to have that conversation with him and I was really hoping we’d be on the same page. I feel so bad for being mean and snippy and I know I shouldn’t be like that. any advice on how to process this in a healthier manner? We’ve always had a great relationship but now I feel so sad and grumpy.

Also, I have a fertility issue so I feel like the longer I wait the less of a chance I’ll have to actually have a baby and it scares me.