City to the Suburbs?

St
I'm looking for some input...my husband and I live in Brooklyn, NY. East New York to be specific, so not "hipster" Brooklyn. He was born and raised here on this block. I grew up moving around a lot, but spent most of my life in Greenville, SC. 
Recently, we have discussed moving because the housing market is ridiculous here along with cost of living. My husband owns a car dealership and we actually end up shipping most of our cars to the South. I am a photographer so I can take my business anywhere as well...We just spent a week and a half by my parents in SC and my husband wants to consider moving there. My question is, has anyone on here moved from a big city to a smaller city? What was your experience like? What was the hardest part for you? 
Of course, I feel very comfortable moving. I moved to NY on my own, but he has always lived in the same place...my worry is that he may not be happy in SC and I don't want that of course!