When do you know you have too many kids?

I have a 6 year old girl Emma Grace, a 4 year old boy Evan Jon and a 7 month old boy Eli Roman... And possibly another one on the way. ( haven't gotten my AF yet) My husband and I want one more and tubes tied. I rather have them back to back and get it all over with; while he wants to wait at least 3 years. But he knew what he was getting himself into because I'm not on any birth control. Is 4 kids too much? I am a family of 7 while my husband was an only child.