Is it Irresponsible to have Kids After 30??

I ask because someone I work with said that it's irresponsible to have kids after 30 because you're too old and there are too many health risks, etc etc.  This hurt me because I am 32 and my husband and I have just started ttc.   
I would not have been emotionally or financially ready to have kids before 30 and I see people over 30 having kids all the time with no issues.  It's not like I'm 45 or something.  I am 32 and healthy.
My coworker had her first child at 21 and always says things like "oh, I couldn't imagine having another kid now.  It's irrisponsible."  Or "I'm glad I had my kids when I did because now I can enjoy my life and freedom.  I couldn't fathom having a small child at 30."
This is all well and good for her but she isn't me and I would not have been ready for a baby at 21.  I do not insult her life choices.  I'm ready now and I don't feel like 32 is too old.  I still feel young; I am healthy, my husband is healthy, what's the problem?  My doctor doesn't think I'm too young...
It's just hurtful to me because this is my life and now is when I am ready to have a baby.  Not 12 years ago.  Not 5 years ago.  Now.  And I don't like being told that I'm basically a horrible person for waiting until I'm ready to try for a child, especially when I feel that 32 is not really that old.