Neighborhood kids...

So we moved into a new area back in december...a rental home. Just a little back story before I move ahead...back in August we had to move in with my parents because my lease was up and I lost my job...so while my kids dad and I were saving just to find a place we decided to just go with something affordable just to all be together because the kids dad was not allowed to stay at my parent when our lease was up. So we found a place in December as I stated earlier and we really just been staying in because 1 there's nothing to really do around here and I'm still looking for work so I'm limited on activities close by...well as the weather is much nicer now, the neighborhood kids have rung the doorbell and asked to play with my son...he is 4 1/2 and they are all like 10 and older. I let him play and watch him like a hawk until its time to come in but they are a but much for my liking and I don't like the age difference...they stalk my door till I let him come out...then always asking for food and beverages...not even asking but demanding and when I give them something they offer more kids on the block my stuff like wtf...and they don't realize he's only 4 and ask like "why is he talking like a baby" and "I thought he was 2 because he talks like that". I also just hear stuff they talk about and it bothers me...I get it completely...they are kids but they aren't my kids and it gets annoying when they leave trash in front of my house or just be too comfortable like I don't even know their parents. Am I being to over protective? I know he's getting older but I personally don't like the area we live in and how old the kids are but he throws a fit when I tell him it's time to go in...what do I do? Should I just let them play together and set boundaries or find some mommy friends with kids that are my kids age....

No harsh criticism please I'm just new to this phase of parenthood and don't want to hold my son back but I also don't want him just around anybody without knowing their parents...especially when they ask for food and stuff or if I have to say something about what they say to my baby.

I think I'm just being over protective...help me out here...