Am I the asshole?

De

My two and a half year old son has a problem with sharing. Every time we go to the park he finds some other kids toy and takes it. The parents are always okay with them sharing but my son throws a massive fit and won’t give them back. Every time we go to the park without fail I have to wrestle my kid to get the toy back. He is also in speech therapy and has a harder time expressing his feelings. As of recently I have tried to distract him from toys and when he grabs them I tell him to put them back just to avoid the fight. This last time an older man said “ really it was fine he could’ve just had the ball.” Then when I explained to him what happens he told me they were rich and could afford more. I feel like they are undermining me when they say things like that. I know they’re trying to be nice but its not like I am intentionally being mean to my kid. I feel like such a jerk whenever I try to take the toy away but I also have an infant that I have to carry while trying to wrestle my toddler. I’m just frustrated about trying to keep my kid cool.