happy with one

My husband and I are happy only having one child but we constantly get comments from family and friends about when and what our next child will be. It's almost to the point where we are nervous to break everyone's hearts by telling them we aren't planning for more. Anyone else happy with one and in the same boat? I don't see anything wrong with having one child but feel many people think so negatively about it. Our son already has many friends born around the same time and many young cousins so it's not like he won't have playmates...