Why can't I orgasm ?

I've been having sex with this guy who I love. I never was able to have guy on top of me or at least lay in bed or sit next to me without me going into a panic attack because of my past. But with him it's different. I trust him. When we first started having sex I would go into panic attacks and he would stop and hold me and make sure I'm ok. Now we can have sex without me panicking because I feel safe with him. But he is upset because he can't make me orgasm and he feels like he is not doing a good job. I never could let him go down on me but now I love it when he does. There are some things that he can't do. I don't like when he fingers me but Sex is amazing. Idk tho. Is there something I could try or... ? I'm not sure. Any ideas or tips ? My friend says it's because my body is still scared of guys ? Idk what that means but my legs and I feel like I'm about to but it just stops idk.