Anxiety about going out...

My mum convinced me to go out when bubs was a week old and now I don't want to go out again! It was extremely overwhelming and I had this stupid old man telling me I was taking my daughter out too soon and commenting on everything I was doing while sitting at a cafe... I have the blues really bad and usually I don't let people get to me but I just feel so anxious about going out again... has anyone else felt like this? What do you do to overcome it?