SCARED

I have started seeing this guy. When we first met it was in a extremely crowded place, yet somehow I managed to pick him out of the crowd and fall for him instantly. We made a lot of eye contact and it turned out we had mutual friends and got introduced. I have seen him 3 times since then, which was over 2 months ago. We get along insanely well and we have spoken everyday for the past 2 weeks.
We kissed the night we met but not since then, but that doesn't really bother me. 
A relationship with this person sounds so exciting and fills me with joy just thinking about it, and I think they feel the same. However, I think I have fallen for them so much that I am scared to be in a relationship with them. I'm scared that I will lose them and it will hurt too much. 
At the moment our conversations are really fun and cheeky. I'm worried that maybe that'll die out and he will get bored of me. 
We are like minded and both doing something with our lives and careers. 
I am so infatuated with this person, more than I have ever been with anyone, and honestly do believe it was love at first sight for both parts... hopefully...
Should I be worried about losing him?? What should I do!