Cloth diaper question...

I want to cloth diaper, and have done some research into it.

One flaw in my plan is that I know dryer sheets are the softener of choice for where I wash and dry my clothes. Therefore my worry is about residue left in the dryer and washing my diapers in them only for the diapers to become water resistant because of the dryer sheet residue.

If i always did a load of other clothes first without dryer sheet would that be enough to get the residue off the dryer before putting diapers in there? Or is cloth diapering going to be a lost cause, I dont see the point in having to strip them every week just to fight off the dryer sheet residue