Sex Drive After Birth Control

I've had my iud for almost a year now and here recently I lost my sex drive almost completely. Could it be my iud? Or something else? I really just want to stop taking birth control in general but I'm so afraid of getting pregnant. I already have two babies (1 & 2) and they're 15 months apart and my husband and I are done having children. I'm afraid to try different birth controls, I fear I'll gain weight or become severely depressed like I did when I was on the pill. And I'm not skinny by all means but I'm finally at a weight that I like after having my two babies. Any advice?