Need advice please

So my boyfriend and I think I might be pregnant because my period is 19 days late now and I’ve been showing some symptoms here and there. I haven’t taken a test yet because I’ve been out of town and he doesn’t want me to tell anyone until we both know for sure. But that’s not what I need advice about. Today I woke up feeling sicker than usual and he started talking about how he thinks I can’t handle a baby and suggested getting rid of it, like abortion. He said small and fragile things annoy me (which they don’t, I’ve just been irritable lately because I haven’t been sleeping well) and I explained to him the truth behind it. I also told him that I couldn’t do it even if I agreed with him because I would hate myself afterwards. He seems to have let it go for now, but should I be worried? What do you ladies think?