Showering

I have a 3 week and 6 days baby boy; we started back on nursing after a rough start but for the past few feedings he latched fine with hardly any issues; but I wanted to get a shower before feeding him again and he was not having it. I assume it's my soap and shampoo and my mother in law had to take him because he didn't recognize me anymore. What can I do to keep my scent mostly after a shower and how long does it take to get that scent back? I read it takes 3-4 hours but I'm in the habit of feeding him before or after a bottle. So, I don't want it to take that long if possible.