Nervous to have sex after baby.

I had my LO 11weeks ago and her father and I are separated. He never made me feel attractive to begin with and my pregnancy made my confidence completely vanish. Now I want to enjoy another man's company but even kissing him is sending me into complete panic attacks and my whole mood changes is he compliments my image. Please help. I don't want to be this scared.