Would you move?

My SO snapchatted over 30 different girls in the beginning stages of our relationship. I forgave him, but it was all girls in his home town. We are now expecting and he wants to move back to be around family, but I’m not comfortable being in a small town around all the girls he cheated on me with, and he said I’m selfish for not moving. What would you do? Am I crazy? Or would you feel the same way?