Prior abuse leads to me hurting him

I was abused prior to my to our my relationship and sometimes I get scared. Or I'll flinch. He thinks it's because I think badly of him. But it's because I still have residual instincts..... what can I do to fix this? I can't bear the fact that my shortcoming hurts him