Just need to vent: rude family members

I went to my husband's grandmother's house this morning for Easter and one of his uncles looked at me and said "Well you guys didn't waste any time." I didn't even know what to say back and all I wanted to do was cry. I realize we only got married in December but we have been together for over a year. And not that it was his business but we had actually been trying since September. This is the first baby I've had in 10 years. (I have a 16 year old and a 10 year old) I was just so excited that I could still get pregnant after so long and people say the most awful things to ruin it.