What do you call you SO when your talking about them?

My husband always says ole lady. He's a biker so it's a term of endearment. When my sister heard him say that she got so user with him and said that's disrespectful. I wasn't there to let her know its doesn't bother me I've only ever called him my hubby nothing like ole man or anything I got 2 questions. What do you call your SO and do you think ole lady is disrespectful?