Finding another doctor? what to do?

So my hospital is being super unproffesional and I'm debating going elsewhere but how do I go about it? It took me forever to find this doctor, so if I do find another one, do I tell them I still have another doctor? Do I let my old doctor know first? Do they get all the papers from the first hospital? I'm confused as to how it all works.