Frustrated caregiver!

So I'm back at work today and my administrator says that I still have to lift the patients for two more days. I'm 10 weeks and 3 days pregnant and I've already gave him a doctors note with weight restrictions of 15lbs. Working with a lady who's 65 and can't do any lifting sucks for me. I'm worried about myself and my baby. Last week it took 2 days for the pain to go away from the lifting I have to do at my job. I don't know what to do anymore. Do I not show up those days? But that's irrisponseable and not something I'd like to do. I'm so frustrated.