2nd child guilt

I will be 16 weeks tomorrow with my 2nd child. My son is 6 and I'm so worried about this baby. When I had my son I hardly worked and my husband paid all the bills. Our lives are so different then it was 6 years ago and I'm worried that this baby will get the short end of the stick. We're older, we both work and both go to school. I love this baby and I feel guilty that I can't give him the time he deserves as I did my son. Someone please tell me you feel the same.