I’m not sure I’ll be satisfied with three kids

So my (common-law) husband and I plan to have one more baby eventually to bring our total number of kids up to three. Our first baby was a surprise so we never had the talk about how many kids we wanted until after she was born and we compromised on three since I wanted five or more. But now that we’ve had two and we’re thinking about when to have a third I’m just not sure if I’ll feel satisfied with three. I still really want a big family. Does this feeling ever go away? If you stopped earlier than you wanted did you regret it? I just feel so sad when I think that we only have one baby left.