Help! How do i convince my husband to have another baby.

OK I just had my first baby 2 months ago. My husband and I have been together for 6 years and in that time I took the place of mommy to his other 2 children as their mother is out of the picture. Anyway, we just had our first baby 2 months ago! So happy! We agreed on only having one even before I got pregnant! I feel this empty hole when I think we will not have another baby. I know for me I truly only want 1 more....not 2 or 3. Ya know. So yesterday I decided to ask if we could have another. I would like to not go back on the pill ya know because last time it took 6+ months to get pregnant the first time. I said I'd beg an my hand and knees and I will forever ache for another baby the rest of my life. I said we already have all the stuff a baby needs. I said he could schedule a vasectomy after I get pregnant or I would be willing to get fixed myslef. I would like to have the kids closer in age if we could also. So he didn't say much during the conversation. He didn't say no and he laughed and smiled a bit about it. So last night we had sex and during he said oh so you want to have another baby? So I went to be thinking oh cool....that's a yes! This morning before he left for work I said. So u remember what u said last night? He said yea I don't want to have any more it was just the heat of the moment and that's why I said that about having another baby. I am sad. So what do I do now. I am mad he said that if he didn't mean it. Do I give it some time and bring it up at a later time? All I want to do it talk about it with him but I know that it's not what I should do because it will push him away I think. What should I do?