How to get rid of ants in house

I want to start off my saying my house is NOT dirty. But in our backyard we have soooooo many ant hills and they're the tiny little brown ants not the big black ones. But if my son drops 1 crumb and I don't see it there will be ants that literally appear out of nowhere. I sweep like 2 times a day. I just don't know how to get rid of them. I clean up. I try my hardest to not let even the tiniest crumb on the ground but no matter what they keep coming. This is a pretty new thing too. It's been the last 2 months. Sometimes you wont see them for a week and then sometimes there's like 20 in a line that come from nowhere. Sorry if this is gross I just need help on what to do lol