We want to keep the gender a surprise

Ana
My husband and I went for our 20 weeks scan and found out the baby's gender. However, we want to keep it a surprise and this is not being taken particularly well. My mum is making me feel guilty, but his mum is even worse and telling him she isn't happy about it. The worst is colleagues questioning "why don't you want to tell us!". I thought it would be easier. I saw it as our secret for a few more month, before we share it with the world, as well as keeping some freedom around baby stuff and name choice... But I'm starting to wonder if that's too much pressure on my other half.
Anyone having the same experience or an opinion on that matter?