swelling after sex

Okay so ive only had sex 5 times and its always been with the same guy. But lately ive noticed that every time that we have sex my vaginal opening gets swollen, like very puffy and im not sure why. Shouldn’t it stop getting swollen after the first couple times i have sex? ( we dont use protection)