Feeling the nerves

So I am 20 years old without a license  and it stresses out knowing everyone around me has one. I have only driven a few times on an empty street  and I live in L.A. a place where there's lots of traffic. I get stressed out because I really want to learn but I'm scared. I just wish it came easy for me but it's not. How was your first driving experience?