12 Weeks and thinking of changing my doctor

Has anyone else decided to change doctors during their prenatal care? I've already been to my doctor 3 times but I'm seriously considering going to another doctor that is highly recommended by others. I'm thinking this would be very awkward to switch now but I'm thinking now is as better a time as any. I'd really like to hear from anyone that's been through this before!