New job with ttc

I have a New job as a manager at subway I would work Monday-Friday 9 or 10 am until 6 or 7 pm I'm going to make good money so that's not the problem. The problem is me and my SO have been ttc for 5 months now and nothing yet but it will happen soon hopefully this month ❤👶❤ with the new job I know it would be hard physically with being preganat but it's possible! I just don't want to leave my baby so long I mean the baby will be with daddy but I just don't want them to feel left by me being at work.. Am I crazy or doesn't anyone else feel this way or have a job like this?