Smoking weed while on the pill?

I just got the pill yesterday! I've read you can't smoke because it increases your risk of clots and heart issues, but I'm assuming that's for regular smokers. Does anyone smoke weed occasionally? Like 2-3 times a month, and even then not like stupid high. I smoke to help with anxiety flare ups and it's the only thing that helps. Do you think it would affect the pill at all?