Me and My Boyfriend sit in silence almost every time we're together

Pualei
Should I be worried that we literally have nothing to talk about? And We're both socially awkward? We have more sit in silence moments than talking to each other??