Don't even know where to start but..

this is hard to explain but I've never had a problem with my vagina, everything sits in perfectly and nothing hangs out. but in the last year after sex my insides flaps (I guess you call them) hang a little bit out just under half a cm, it's so uncomfortable to walk after sex and they get dry so I always try push them back up. the next day it goes back to normal but is there any way I can stop this? surgery?