Job affecting TTC!!.. looking for a change, need advice!!

Sabzz
So me and hubby officially started about a month ago TTC!  Only thing is we don't BD often enough and I feel it's because of me. About two months ago I started a new job (temp to perm) and I drive 40 to 50 miles one way so you can imagine, I am so exhausted I only want to rest and so I am in bed early and he stays up and we don't do the deed.. I like the job somewhat but the commute drains me and I feel like it's affecting our plans of starting a family.  I now have this opportunity to work at a place closer to us where I will be doing the same thing which I like but I won't be driving long hours and will have more time for us.  I'm torn because I wonder if it's the right move and if it's a good enough reason to look for another job.