Is it really wrong to date my ex’s friend

Hey everyone, i want to get some opinions, from someone other than family. So I was with my baby’s dad on and off for the past 10 years. I ended things with him over a year ago. I finally realized that we are both just wasting our time. I care about him but I was not in love with him anymore. I was just trying to make thing workout for my son. He had problems going in and out of jail and that’s was the main reason why it didn’t work out. A few days later after we broke up he went to jail again. When he was in, i got a message from a girl telling me he had a baby with him. I told him about it, he took responsibility for what happen and when he got out of jail in Feb 2022 he got with his new baby’s mom. (He was in jail for about 7 months) . So about 3 months ago I got a call from my ex asking if it would be ok if he gave one of his friend my number. He said he caught up with a friend who I’ve met before when we were together. So I said sure what ever, because I honestly didn’t think much of it and I also wasn’t seeing any one since we broke up. I had talked to other guys but it there was no connection with them, it seemed that they just wanted sex and I didn’t want to be just a booty call. So When he asked me I was like he’s cool I don’t mind talking to him. So few weeks passed and his friend actually messaged me. I felt weird at first but the more we talked, we got to know each other and it was different with him. We have been seeing each other for about 2 months. I don’t know how serious this will go but when my family found out that he’s my ex’s friend now they’re telling me that it’s super wrong, that’s it doesn’t look right, that I must had been desperate. They use to always tell me that I should go out because I was always at home and now that I am they just don’t agree who im going out with. Im grown and I know I can make my own decisions but I’m curious to know does it really look bad to date my ex’ friend?