I need some advice.

My family (apart from my mom) sees my relationship as a joke, We've been together 5 years 8 months, and been engaged for almost 5 years. my so is currently out of work and is struggling to find another job, we're ttc without anyone knowing because I'm sick of being told he's not good enough! he's stuck by me through everything including a mental breakdown (part of the reason he lost his job) but no one sees that side of him other than my mom. My sister told my mom he shrugged his shoulders when she asked him if he loved me but I don't know if I believe her because we have a bad history and she has never liked our relationship. I don't know what to do and how to move past this, yes he drives me insane but I love him and now I'm doubting what he says to me and how he feels, I feel like I'm torn between him and my family, even though everyone in his family has accepted me as their own and treats me like one. I'm so confused and I've got no one to talk to about this