I don't like to be on the phone forever:(

So my fiancé and I are long distance. So we use skype and and watch movies together too stay close. He's a big competitive gamer so he spends a lot of his time computer and Xbox gaming. When I'm on the phone with him while he's gaming he usually gives me half ass one word answers. And I get it because it's hard for him to concentrate on a conversation and his game. So usually I just say okay I love you and I'll talk to you later and I hang up. Well he gets sooo mad at me for this! He tells me that since we are a long distance couple we need to hang out more online and on the phone to make up for this, but I don't understand how we can possible become closer from him not responding when we are on the phone? How is that spending time together? And sometimes I'll see he's upset so I stay on the phone but the awkward silence gives me anxiety and makes me feel like I have to keep the conversation going which isn't possible because he doesn't respond to me when he's gaming. Like I'm happy that he has a fun outlet for him but if he can't talk to me why do I have to stay on the phone? Am I wrong for this? I just feel like why stay on the phone with someone who's not talking?