She isn’t his....

I have been with my husband for about 11 years. We are not legally married. He is still married married to his ex. He had two kids with his ex, she is not around. When they first got pregnant and married he was a senior in high school. Anyway me and him met in church and he was separating from her at that moment. I was only 17 going on 18 years old. He is 9 years older than me. The kids were 7 and 2 and a half when we met. They are 18 and 12 now. It’s been a long tough road. We hit it off in the beginning, but we bumped heads because I was so much younger and he was older and had gone through a marriage and had kids already. We were good for about a year. Then we started arguing a lot, it was mainly about the kids or his ex. Or my Facebook! Anyway we have separated twice. Once he broke it off and said it was because of the kids. We broke up and it lasted about 6 months we got back together. The second time around I got my shit and left. I was tired of a lot of the disrespect from him, his kids and his mom. She hated me because she said I was too young to understand how to be a mother to his kids and blah, blah, blah! Anyway I got pregnant when we were separated and we had been away from each other for about a year. He was out of town working and we still kept in touch, but he was doing his thing and I was doing mine. I lived with a roommate then. The guy I got pregnant by didn’t want anything to do with my baby. Anyway my husband finds out I am pregnant and he decides he wants to give the baby his last name. But get this before I got pregnant we had tried for about 5 years to have kids and we never could. I sleep with this other guy and I get pregnant. My husband was livid and there were times were he would tell me to give my baby up for adoption or have an abortion. I was miserable at this time. So anyway time goes by and now he treats my baby like his own. The baby is now 3 soon to be 4. We have been fighting a lot lately and when he gets mad he brings up old stuff. The kids are older and I am just stuck between What do I do! I just want another woman’s opinion! Help! There are times I want to call it off and leave. Get my baby and all our stuff and leave!!!! We argue and he says some harsh things! We still to this day argue about the kids. He hasn’t officially gotten a divorce... I have never gotten a ring! Idk! We argue about stupid things!!! He brings up how my baby isn’t his or how I slept with another man.