Anxiety

I’m currently 13 weeks pregnant and really struggling with the idea of my pregnancy being public knowledge, I don’t know if this is because I’m scared something will happen but I just don’t feel ready to deal with people looking at me and asking questions. I think my manager is getting impatient with me not telling people as she told three colleagues today and told them to keep it on the ‘down low’ - one came to congratulate me and I just didn’t even know what to say. I am excited but i just can’t help but feel so much anxiety and worry. Does the worry of ‘what if?’ ever disappear throughout pregnancy?