Just curious

Valerie
So according to my dr and due date they are saying I got pregnant around the 2 week of November.... I didn't have sex from October 17th until November 20th. 
Me and my boyfriend had broken up I had sex with someone else on the 20th of November. But according to the dr I was already 3 1/2 weeks on that day. So I told him. Of course he flipped and was like its not my baby. Me & my ex have been friends for almost 5 years and have been thru hell an back with each other. So my ex has said he doesn't care if the baby isn't his, he is still gonna be around for me & the baby. We even picked out names together. We have started trying to work things out. But the only problem is his oldest daughter hates me as does his ex wife! Which they are the reason we broke up! Anyway I don't understand how the dr is telling me one day but I know for a fact I didn't have sex at all.... I also keep reminding myself they did this with my youngest daughter, telling me I got pregnant one day when I didn't have sex..