Virgin and first time tips

I’m a 20 year old virgin and i tried having sex for the first time with my boyfriend( he’s not a virgin), but we had a bit of a problem. He wasn’t able to penetrate me and we tried it with a condom and without( i know that wasn’t the brightest idea). He fingered me for a bit to stretch me out but it still didn’t work and after awhile i got tired trying and he ended up jerking off. I don’t know if i should be worried something is wrong down there or if we did it wrong. Any tips would be greatly appreciated.