Struggling with this

So yesterday I told the person I’ve been with that I was pregnant. We aren’t in an official relationship. When I told him the first thing he said was that couldn’t have a child right now, implying abortion. He didn’t yell and he didn’t seem angry with me. He told me that he was sorry and felt like it was his fault. He also kept repeating that he wasn’t mad and he was just scared. However he made clear that he can’t have a child right now and he wanted to make sure I was “on the same page”. Conversation ended with him telling me he would give me money (which I refused), it’d be okay and him giving me a big hug and a kiss on the cheek. I don’t know what to do at this point because I really don’t want to get an abortion, as that goes against my personal morals. I just don’t think I could emotionally handle doing that. Any advice?