Wanting affection

How can you get your boyfriend to be affectionate towards you? I cry myself to sleep some nights because of it. He never holds my hand, he barely kisses me (usually when we leave for work and when we go to bed) I try to cuddle with him at night and he gets mad at me, we only have sex when I feel like he wants to and usually it’s because “he just wants to cum before bed” his words. I just don’t feel loved in an affectionate way. He does provide for me and our son and my daughter and pays most the bills while I pay a couple and pay for groceries. I just wish he was more affectionate. I’m wondering if his mental abuse is apart of why he’s this way.