Worried I won't spend enough time with my baby

I'm self employed and work from home, my SO is a house-husband. We're having our first baby in November, and since my husband will be caring for the baby while I'm working 9am - 5pm, and probably doing the night feeds too, I'm worried I'm not going to see the baby enough and bond properly. I'm thinking maybe I can spend time with the baby from 6am - 9am and then 5pm - baby's bedtime, which should give my husband more time to sleep / relax too. Anyone else have this problem?