Nasty rumours

Im 9 weeks pregnant with my first child and me and my boyfriend couldn't be happier. We were trying for less than 3 months before we got our bfp. We decided to keep it quiet that we were trying to conceive as we felt that it was nobodies business but ours. We are 24 and felt that it was the right time for us. But my friend has heard rumours in my boyfriends work that a lot of people have been spreading. Apparently a lot of people have been going about saying that I've "trapped" my boyfriend with this pregnancy and that Ive done this on purpose so that he can't leave me. This is not the case as my boyfriend was so involved in the whole process of me coming off contraception and actively trying. I'm not sure how to react at the moment and feel like people are trying to ruin our happiness. Did anyone else have this happen to them?