Vaginal pain

So my boyfriend and I have been active for about a month and since we first had sex, it hurts to pee. Usually just after we have sex but it'll go away in a couple days. But the pain hasn't stopped so I took a mirror and looked down there and it looks like a tiny red bump or scratch and the very bottom of the vaginal opening, that piece of skin. Should I be concerned and go to the doctor? Or should we just play and cool and see if it goes away again.