I fell ugh :/

So we were heading to the new house to paint the baby room and I was walking down the stairs and fell two stairs, so clumsy. I landed on my elbow butt and ankle. We went to the new house I felt fine just a little ankle soreness, it really swelled up so SO brought me back to the apartment and got me set up. I called dr just to see what they would say, if i have bleeding or cramping they said they could get me in but I'm having neither.  She said baby is so protected in there and not to worry, can't help it though. Should I be worried? Besides the swollen ankle !