Debating on breaking it off

I have 3 kids. 5, 3 & 5 months. (I left his dad when I was 7 months pregnant).

I was child free for 2 weeks & I was seeing this guy every day for that time. The kids were with their dad. Now the kids are back, and I already feel idk the word… Unmotivated I guess to try & make the effort in seeing him. I invited him for dinner but I had to bail because my baby woke up & he wasn’t having a good evening.

I feel like it’s unfair to him as well, he’s a busy man with no kids & I have 3 of them & I won’t have much free time. Only on weekends &/or when my kids aren’t with me. I also feel like that it wouldn’t be ideal for him. idk lol. I just want to save him the trouble.