New Relationship Problems 😥

So I've been talking this guy for awhile and we decided to start dating. It turns out he just so happens to be a friend to my child's father and his family. It really bothers me but he seems not to care. It's been about a week into the relationship and he ALREADY says he loves me, wants to have sex, he wants me to have his baby and eventually get married. I guess I like him but I don't think I can get over him being my baby's daddy friend. Apart of me feels like its a set up or he's a crazy stalker. I been telling him I want to take things slow but really I'm unsure about the nature of this relationship and I'm not sure if we should continue on. Am I just freaking out or is it normal for me to feel this way ? What should I do ?