idk what to do

Idk if I should break up with my SO. We've been in a rocky spot for a while and when things seem to be all worked out, another problem emerges. My parents say that he is abusive and fucked up, while my friends don't really see it. He works 13 hours a day, so we don't really talk a lot, but when we do it's really fun. I seriously love him, but I'm tired of coming home ever break and hearing how he's terrible and dangerous and etc. I've asked my friends to look for red flags in case I have rose colored glasses, but they have found nothing. He always acts like a gentleman, but misses some social cues due to autism. I was told that he was a wonderful boy and tried to pay for dinner when he met my parents, but my mom told me she made the whole thing up so my dad wouldn't kill my SO for disrespect. Idk what to do anymore. When I'm not at home, I love my SO, but when I'm home, I hate him. Any thoughts?