Feeling guilty over 2nd baby

Is anyone else (if this is your second baby) terrified you might favorite this child better? Obviously we haven't met our baby yet, but our current son, we've had a lot of challenges to overcome. He's been quite a handful, especially as a baby, and it's going to kill me inside if his sibling is "easier" I guess you'd say. My husband broke down to me the other day he had the same fears and while it isn't what anyone wants to hear, or say out loud, I feel like someone out there has to have the same fears. Or maybe advice?