How practical is gardening with a baby?

I love gardening. I like to keep a veggie garden out back, and will do the front flower bed too and a mini one in the back. I’m expecting my first in March though (which is normally when I start seeds) and will be on maternity leave through early/mid June, depending when he comes, so all the plants would need to be in before I go back to work anyways. I’m fully expecting to be exhausted and overwhelmed at first, but I’d really love to still put a garden in so we can have at least some fresh homegrown produce. We have a monitor with video, and our yard isn’t that big, so I was thinking I could work on the garden while the baby is napping and just keep the monitor with me so I’d know if he woke up. Or is this completely impractical as a new momma?