Should I continue on the pill or...

I've been taking Yaz - pills for ~ 6 months now and they have slowed my sex drive close to nothing, I cry all the time and sometimes I'm just feeling numb and not feeling anything towards my bf. BUT these past few days have been better than ever, I've had sex with my bf 3 times this week and I'm feeling great so now i'm kinda lost if i should continue or go to the doctors.. (sidenote: I have just recently stopped taking my anxiety medication which helped me with the mood swings)