Is this toxic?

I'm dating a man who I'm not sure of anymore. I feel lost and I need help.

We've been together almost a year and I wanted to make it work. We started having issues when he accused me of having feelings for my ex because when we got divorced I didn't change my name immediately (I didn't know him and I was more concerned with the new custody arrangements for my 2 yr old). Then because I picked up my son alone and may come over 5 or 10 minutes later than I originally said. I got accused of having some feelings for him which I never have. If he came up in conversation he would get mad no matter what was said. Then it was that I don't spend enough time with him because he works overnight and I spend every weekend with him and he expects me to rush home to see him before he leaves. If I dont want to kiss or just want some space he takes it personally. Sometimes it's because he tries to force me or guilt trip me into his hobbies. I love him but I don't like that I'm constantly blamed for hurting him or liking my ex. I also feel a little held back. I want to buy a house and adopt a child and he wants to rent and doesn't trust adoption. He doesn't want to risk getting a bad kid. He also wants me to have his kid instead which I get but still... I'm not sure if I can fix it or if I should just walk away.