Thumbsucker!

Does anyone else have a thumbsucker? My 2 month old will not take a pacifier and will only take his thumb. I've tried multiple different kinds and he pops them out and in the thumb goes. Should I just let it go or keep trying to get him to take a pacifier?