Worried to many people know

I work at a mental health facility for kids. Part of my job is having to physically restrain kiddos when they are to dangerous to themselves and others. So when I found out that I was pregnant the first thing I did was tell my boss that I would no longer be able to restrain. Word got around my work very quickly and some people were able to put two and two together without me even saying that I am pregnant! Now I'm worried that to many people know (for sure more than I had intended for this early on) and I don't know what I am going to do if I loose it. I'm only 6w and the whole process is terrifying for me!!