How long for hcg to go to 5>?

I found out I was 122 Monday at basically five weeks. Two days later, 131. They took my blood yesterday, a week since, and it was only down to 103. Shouldn't it have gone down more by now? I'm kinda worried, but my doctor just wants to keep testing till I'm under 5. Anyone have this experience?

Nothing like having to keep going to the OB office full of pregnant women. Talk about heart breaking. Sorry is this is asked a lot, I'm not quite sure how to search this exact topic. Thanks everyone.