Scared about sex

I'm 16 and I've been with my boyfriend for 4 years and we have been talking about having sex. I'm definitely ready and feel comfortable with him but I'm so scared about it being painful, like does it hurt or am I just stressing about nothing  (I'm a virgin)