Leaving for a lower paying job?

Hi! I currently work at a pretty well paying job that has good benefits and I am considering taking a $6 pay cut for a job that has slightly less benefits… The only reason I am considering this is because my current job has been working us 7 days a week (60+hrs) for nearly the entire pandemic. I had a baby during that time as well, and I have been struggling emotionally not being able to spend enough time with him. The job I’m considering going to was a job I worked at for 7 years prior and I have potential to move up when I feel ready. I am currently the only one working, since finding childcare with my work schedule is difficult. My husband would go back to work (at least part time) if I made the switch to help with bills. Is it wrong of me to want to leave? Am I being selfish? How many people have made a switch in jobs lately? Lol I am so conflicted because I want to provide for my baby, but I want to see him too. It’s eating me up…