getting rid of dummies

We have our baby a dummy from 2 weeks old and it worked wonders. He's now 13 weeks old and my husband hates the dummy and wants to get rid. Obviously this is easy for him to say as he doesn't have to deal with him crying etc all the time especially at baby groups! I think our baby does rely too much on the dummy and I do give into him too easily. I said we need to get rid of it during the day first then at night but I feel a dummy could help us through the early stages of teething.