Should you ever have to ask your significant other for attention/affection?

My boyfriend tells me that I shouldn’t have to ask him for attention/affection and he’s right but when he rarely gives it to me it’s hard not to ask. We’ve gotten in multiple arguments because of this. He says that I’m smothering him when I constantly ask him. It’s my love language and I’ve told him that but sometimes it gets hard. He’s a great guy with a great heart but idk what to do. He hasn’t had such an easy life when it comes to family and I feel like maybe that’s why being affectionate doesn’t come easy for him. I’m trying to be patient. We’ve been together for 3 years already and idk what the future holds for us sometimes. Maybe I’m just being dramatic.