not using lube and tearing?

So I'm just wondering if this is normal or not or if something is wrong with me, I lost my virginity about a year ago and I haven't been having sex reguraly I have it maybe every 2 months because my so and I are long distance, but sometimes when I go running or excercise or take a shower I notice I have just a little bit of pee in my panties, sometimes a little more than others. Is this normal? Like sometimes it even feels uncomfortable because I can tell when it happens yet I can't help it! And this didn't start until I lost my virginity. I remember the night it happened I was kinda dry and we didn't use lube and it hurt really bad but I thought that was just because it was my first time? Now I wish I used lube but could this have caused it? Or is that normal? Can I fix this anyway by going to the doctor? I've been doing kegals as well but it doesn't seem to help:( Is THIS NORMAL?!