Too tense during sex?

Sometimes, when I'm fooling around with my SO, I find it rather difficult to actually get him inside of me. I think this is because I may be tensing up my muscles, but I've been trying to relax and it doesn't seem to help. And suggestions?