Help!

I am 22 weeks pregnant and woke up this morning around 5 am with severe pain under my right rib and around to my back on the right side. After about an hour it finally eased up about and now I just have a dull ache/burning in my back. I called my OB and they want to me to go to labor and delivery to get checked out but I feel silly going when I’m not in near as much pain now. But I would like to get it checked just to be safe before it gets any worse. What should I do?