SO wants to change my Dr.

I'm 27wks pregnant. My spouse has trust issues and he's very insecure. Now he wants me to change my Dr, cuz he feels I'm cheating on him with my Dr while pregnant (sounds humiliating and ridiculous) he introduced me to the Dr himself. Right from 6wks we attend every appointment together except this last 27wks that I went alone for my glucose test cuz he wasn't around. We had a hot argument cuz I try to make him understand this Dr knows my medical history very well right from my 2yrs of ttc till my 27wk of pregnancy. I just don't know how else to convince him.