10 yrs messing around

I work 2 jobs, a full time job weekdays and part time job on weekends I have lupus and feel like sh*t all the time. I have a 12 year daughter and for the past years I have been seeing this guy. He has told me multiple time he likes me and I have told him before he should find someone else who has more time for him. I don’t see myself with him or any relationship. He always to meet but honestly I am tired and I don’t think he understands that ..I don’t want anymore kids especially because of my condition lupus. I don’t think he understands how exhausting this is which of course I have explained. I feel like I am the bad person here any thoughts?