Use a conception calculator. I also ovulated later than traditional and apps due date is feb 2, dr went by lmp gave me Jan 29, ultrasound gave me feb 8 which is what conception calculator gave me. 

Okay my last period was May 3rd so it sayd id be 6 weeks but my blood work shows earlier than that so I'm guessing 5 weeks 

Well, it really isn't "wrong" in the traditional sense. Doctors go by the date of your lmp, until you get an Ultrasound, and they give you a better estimate. It would be difficult to go with ovulation too anyway, as you may not know when your egg was fertilized.