He's a virgin.. I'm not.

I'm dating a virgin boy I met from my church and I feel like if I take his virginity everything will go down hill. We both want it and we've been dating for a while now.. I'm just not sure if he understands how big of a deal it is. Any advice?