Huntsville Alabama racism anxiety

I need someone to help ease my mind please! Or at least offer me some advice! My husband and I are a mixed race couple(he’s African American and I’m white) and we are moving to a town near Huntsville, Alabama in a week because he got an engineering job. Where we live now(WA) is very diverse and no one really thinks twice about us being a mixed race couple and my husband has never had an issue with racism. When we tell people we are moving to Alabama, the general response seems to be “ be careful”. We have visited to look at houses, and found one we loved in Madison and everyone was absolutely lovely. I’m just worried for my husband and our soon to be born baby. I know racism exists everywhere, not just in the south. I think I’ve let people get inside my head and now it’s all I can think about.