Time it takes after exercise to return to 120bpm

I've read where after exercise it should take 5 minutes for your heart rate to return to the 120 beats per minute range. I haven't done heavy exercising in a long time and just went for a mile jog. Barely made it at 14:00minutes. I know this is slow and I'm a terrible runner so this is a start for me. After I ended I watched my Fitbit until I reached 120bpm and it took 24 minutes! I know I'm out of shape, but this is nuts! Anyone else have this problem? What does this mean? What should I do to help? I want to have a healthy heart and feel like I don't right now.