Thoughts on looking for new job TTC?

Good morning ladies! So I'm a bit conflicted on this subject and wanted to get some input on the matter. I am currently working in an office that I feel at times isn't the best fit for me as management is not the greatest and most professional and organized. But I'm scared to start looking at other options because I am trying to conceive. I guess my though process is that I've already been here for a year and it took don't necessarily be that devastating of I were to get pregnant. But should I quit my job and try and find a new one...would me getting pregnant so soon after starting a position be a negative against me in my new position. I know that I worry and over think things to much...but just wanted to get some feedback.