Labia hanging...

So the last couple times my SO and I have had sex I've noticed my labia hangs lower/ is more noticeable afterwards. My left side is bigger than my right side. What does this mean? Is it normal? What can I do to lessen how low it hangs? Do others have this problem? 
Ps, my boyfriend actually made fun of it this last weekend- he said "oh look! You're a hanging out".... I had a very serious conversation with him and explained I'm insecure about it. He apologized then.