What's to young to ttc?!

I'm 24 and my husband is 27 we've been married for two years and just bought our first house this summer. We both have great jobs I'm a nurse and he's an electrician. 
We've been getting some nasty comments about trying to convince from his mom saying I'm too young and she won't be supportive. I don't see anything wrong with having a baby now! But of course I want her to be supportive of it when it does happen!
What do you guys think? 
How young were you when you had your first?