I can’t believe he said this?

So apparently my husband (we will be married 4 years in March) has said he feels nothing or is embarrassed by telling me he loves me over the phone when we hang up. He calls it stupid? Says that he feels humiliated because he does this while he’s at work or around his boss and around other people. I like saying it and I mean it because I do fear that if something bad happens and I lose him that I’ll never get to say it again. 1 time we were so angry with each other, we didn’t say it, I ended up getting robbed at shot gun pointe and I was afraid of dying and never seeing him again. I say it when I’m leaving work, or when I’m even going to the grocery store.

Should I just stop saying it to make him feel better.