Wanting Baby number 2

I will be 36 in August. I’m torn between wanting another and feeling too old. I have an almost 5 year old and a 8 year old step daughter. My daughter loves her but she’s obviously not here all the the time. My daughter says she lonely a lot and misses her. I’m a NICU nurse so I worry about things and being older doesn’t help. We tried two years ago for 5 months with no luck and I got discouraged. The doctor gave me Clomid but I never took it. Any thoughts on having a baby after 35???