What the hell is that smell?!

Been with my boyfriend for four years, after the first year we stopped using condoms and I started taking the pill. I noticed a change in the way my vagina smelled just a couple of days after sex. Went to my gynecologist to get checked out & I was treated for yeast infection and BV. 
Over time, I realized that my vagina smelled like him!!! It's not a fishy smell, it literally smells like him!! I love my man but I love me even more. He claims he doesn't smell it but I told him that we have to use condoms because I like to smell clean and pure! (Lol)
Has this happened to anyone before?! I'd love to read about others' experiences ! Any advice would be great as well!