do you get pissed off at learner drivers?

em
In Australia, you have to put L plates up on your car if you're learning, right.
So I'm driving (a manual) with my Aunty, and yeah I stalled a few times, but most people were forgiving. However one man (to the left of me and a few cars back) was pointing and screeching at me, and looked like he was going to get out of his car and come attack me.
If I had my full licence and was being an incompetent driver, I could understand, but I'm literally learning how to drive, so??????
(Question is the title)