Not attracted to my S.O. anymore..

I've recently just become unattracted to my s.o. I can barely stand him 80% of the time. We have a 2 year old, got evicted , so living with my father because he refuses to get more then a 20 hour a week job. Hes SO lazy. We all (his family, my family & I) have all tried to figure out why he doesn't want to grow up and take care of his family. We've tried EVERYTHING. He lies to everybody, constantly letting us all down. And puts me in the middle of things. Making my family and I fight. So tired of it. But its like, I can't leave. I feel too comfortable around him, I'm afraid I'll never find a person I can be this comfortable around again. What should I do? I don't know how to make it work anymore.