I was on the patch and am trying to get pregnant

I have been on the patch birth control for years I want to say 2 to 2 1/2 years. The brand is “xulane” pronounced “zoo-lane” in English. But I know this birth control stops me from ovulating when I’m on it. In a month (4 weeks) 3 weeks I have a patch one patch is good for a week I change it in the same day a week. But one the other 4th week I don’t have a patch is when I have my period. My last period started January 6th and ended January 12th and since January 5th I haves had my patch on typically after my period on the correct day I would put my patch on but my boyfriend who I live wilt and have been with for 4 years and lived with since 8 months together we are clearly very serious and want to start a family I just need to know how long would it take for birth control to go away in my body? We are actively trying for a baby right now?