How should I handle this?

I already have 2 kids. After my second one I said I was never going to have anymore kids. I said that over and over and I even believed it. My daughter was the main reason why I didn’t want anymore, she was so difficult! For the past few months I’ve been thinking about wanting another and now I know I do! My husband has been wanting a 3rd for a long time. I have a feeling the first words that come out of my family and friends mouths is “ I thought you didn’t want anymore kids” I feel like I will get really mad if I hear that every time from everyone! How should I respond if they say that? Or if they say I don’t think you can handle 3 kids