Can a Doctor Do This?

ok so i was diagnosed with PCOS when I was 17. I was infertile w my ex for 6 years. saw fertility doctor and was told I had more eggs on my one ovary (lost one in 08 due to dermoid cyst in an ovary and hd to have it removed). when i met my fiance we had a miscarriage. then i got pregnant w my son 2 years later. i got pregnant again before my 6 week check up afyer i had him. i lost that baby at 8 weeks due to sac not growing w the baby. then i got pregnant 9 months later and had my now 4 month old. i just saw my pcp a few days ago. we were reviewing my Past Medical History and he TOOK OFF THE PCOS! He said with the 4 pregnancies in 5 years that's a physical impossibility (and regular periods started since my first pregnancy) with true PCOS. He said I dont have it. Struck me as odd. Is this possible?