I need some advice

I found out about a week and a half ago that I was pregnant, I was not trying to get pregnant, I took my pill everyday, at the same time like clockwork. My boyfriend and I have been together for 6 1/2 mths, he have a 7yr old, and I have a 2yr old and a 3yr old. When I told him I was pregnant, he was upset, and he barely said anything, actually the only thing he said was, "I can't afford another kid", and he went to sleep, that was a week and a half ago. Yesterday I said to him that we haven't discussed our elephant in the room, because he haven't mentioned it at all. And he said, he don't want another kid until he's married, because he don't want another baby momma, and that was the end of the conversation, if you call it a conversation ? But in my head, I never wanted to be the person, to get an abortion, I'm not against it, but I would never want that on my heart, that I did that to the baby that is apart of me. But at the same time, I don't want to feel like I trapped him into a baby. We both have very good jobs, and is quite stable, and I understand him not wanting another "baby momma". But I was wondering, would I be wrong if I kept the baby?