Confused!

Known him for almost 3 years already, the problem is when I met him I was already in a relationship and still am but with a 6 month old. I'm head over heels for him and I don't know if I should just let him go or give it a chance... But I feel bad for my current partner if I give this guy a chance..