Is it the birth control?

I had stopped taking my oral contraceptive for about a month and a half to see how I felt off of it. I feel like I was very alert and it was nice knowing I wasn't putting extra hormones into my system. My sex drive improved tremendously and that made me and my boyfriend happy of course... Only issue was we obviously wanted to stay just as protected. After much research and a talk with my gynecologist I ended up back on the pill... 😓 Although this is said to be a lower dosage than I was on before, I am scared I will lose my sex drive again and feel other bad side effects again. I'm not sure what to do and today is only day 5 on this new birth control. Thoughts??