I want to have sex, but can't..

Because of a past experience, I haven't had sex with my current boyfriend, who I've been with for over a year. Every time things get going and he's close to pulling my pants down, I freeze and start having a panic attack. He knows my history and says that it's okay and it will happen when I'm ready, but I can't help but get the feeling he's only saying that to make me feel better. What do I do?