How am I supposed to react when people are disappointed I am not foreign??

I always get asked " where are you from?" People think I am African. Even other African Americans think I am African.

When I reply that I am African American they are usually uninterested in continuing the convo. How do I respond to this? It's kinda annoying.