Going off caffeine

During pregnancy. I was only drinking a cup a day but husband thinks it’s best to get off it because the baby’s organs and everything are formIng. Plus I don’t want to put anymore havoc on my poor child than is necessary. Anyone else wean their body off caffeine during their pregnancy? How’d you do it? Do you drink black tea still?