Having a second baby

My husband and I welcomed our daughter into the world March 1st. She is now 6 months and is the light of our lives! We have gone back and forth about having a second child. Now he says he doesn't want another one at all.  Never. I won't lie, I've said that too but only because I wanted to see his response and honestly I feel like a part of me is afraid to have a second. What if it takes too much time away from my first? What is something goes wrong and all the attention has to be on the new baby? What if it is special needs? I have a special needs brother and nephew so I see the demands. However, my heart still wishes my daughter can experience having a sibling. I know the world is a crappy place. I often think, I have no business bringing another innocent life into this awful place. I just don't know. I guess I'm just venting.. :/