Sooo I'm curious

I kinda want to get an outside take on this relationship I'm in. It started like 2 mths ago with this guy who works for my apt. We talked a lot and he was a pretty open person I'd say so we were close enough. Around the holidays he sent his kids to their mom to spend time with their other family and was lonely amd I was lonely bc my family is on the other side of the country right now, so we decided to spend Christmas eve together. This led to us both having a few drinks, nothing too serious, and we had sex. Now before this I was a virgin and I was kinda following my intuition about when would be right to have sex for the first time and my intuition is usually pretty spot on so I waited. When things were starting to get heavy I was nervous about how good I would be at anything and if it'd be awkward and so I was like uh no and we kissed a little and I was like nvm yeah this fun and good. After everything is said and done we sorta sit and ring in Christmas together. The next day he had to go get his kids for something and needed someone to watch them. I volunteered bc I like to help and he didn't want me to just watch them and seem like he was using me so he was like yeah I'll definitely pay you for it so I watched em a few times but idk if I'll watch em again for a while bc they have school and all. Now here's where it feels tricky, I really like him and we're pretty similar on the things that I consider the super important stuff but he's like fresh out of a 12 yr long marriage and is still in that settling phase with how things should work with the kids bw him and his ex. I know we really like each other and we had already agreed that any dating he does has be mostly on the serious scale bc he has his kids to think about and how it'll work for them, but like how soon after ending a long, tumultuous relationship is it ok to really get into dating again. Like should I be slowing this thing down some more bc I'm honestly thinking about it bc I do like him and I want to build on something but also give him space to adjust. Also does this sound like I'm frickin out of my mind?? Just curious

TL;DR: we fucked the 1st time we hung out, I was a virgin b4 that, I've babysat his kids for $, and he's fresh out of a divorce