Swelling on one side more than the other?

So 3 days ago I had an appointment with my doctor and I’ve been noticing some swelling the last week. He didn’t seem too concerned about it and told me to just take it easy. I work 8 hours a day but it’s a sitting desk job so I’m not on my feet much anyways. Well today I had to wear flip flops because the swelling was pretty bad but nothing more than what it has been. I took off my shoes when I came in to put them up on the chair and I seen that my whole right foot/leg is a lot more swollen than my left. I don’t know if I should call my doctor and tell him since he didn’t seem too concerned about my swelling at my last appointment.