Tmi but taste "down there"

So this is a little Tmi but it's been bothering me so I thought I'd ask. I love when my boyfriend goes down on me but I get so self conscious because he says I taste weird:/ I only let him finger me now but he still complains that his fingers smell weird. It makes me feel awful and I don't know what's wrong. I don't have any infections or stds. we are each other firsts and we've only had each other as sex partners. Anybody give me any advice?