I don't get him

I am 17 weeks pregnant, I have 14 year old daughter from a previous relationship. My boyfriend who I am pregnant by has other children, he wasn't too excited about me being pregnant in the sense if I were to opt for an abortion he wouldn't stop me (well that's what I think). He acts as though he's God's gift to women and that every woman wants to have his baby. On one end he acts like he wants to be with me, often times accuse me of sleeping around because I am a bit detached in terms of me not calling, lack of affection and somewhat my attitude. I mean how can I allow myself to feel anything but total disgust for this man when he says such mean things about the baby like "the baby is going to come out ugly" and things like that. He's so hot and cold, one minute he's on board with the baby, then the next minute he's not. Today he even implied that he thought that we should "start all over" with a new baby because he feels that this baby will be affected by all of the drugs he has taken (pills & weed) I just broke down because I do not want to get rid of my baby, so far according to the Dr. everything is going well with the pregnancy. I guess where I am getting at is that I sent him a text stating that it would be best if he just stayed away, in when the time comes for him to sign over his rights, for him not to contact me and that I will contact him once the baby is born to do so. Am I being out of line by making such a request. I just don't get what did myself and my baby do for us to deserve this treatment. I love him but not enough to tolerate this treatment. He can just sign over his rights that way everyone can be happy.