Having sex at 15?

My boy and I have been together for 4 months and we've done almost everything but sex. I just recently turned 15. He brought up going all the way the other night and I said I wasn't sure yet... I know that I love him and I feel the thing that's holding me back is the opinions that people have pressed on to me and influenced me into feeling. I want to do it with him, I just don't know what to think. Any advice?