Parents with one kid!

Okay, me and my fiancé have a 2 year old and we're thinking about TTC baby #2. Do you ever feel bad for wanting more kids? Like I look at my daughter and can't imagine having more kids because I've spent so much time with her and I kind of feel bad because SO much of our attention is towards her. Does anyone have that feeling? I don't even know if this makes any sense lol. We really want more kids, though!