Intimacy after divorce

I'm recently seeing someone after divorce and I have children. I know the person I'm seeing likes me no matter what, but we haven't been intimate yet and I'm anxious with my own self-esteem issues being with a man after only have been with the father of my children who knows me and my mom body. This is only coming from me, I know I'm just in my own head about things, but I'm wondering if anyone else out there was nervous to be with someone else after children who wasn't the father.