Is it too early to say I love you?

So this guy and I started talking. we are both in college and went to the same high school. We rolled with different crowds but some how found each other. He pursued me on Instagram saying that I was so beautiful and we could make it work (it was more elegant when he said it I'm paraphrasing). Any who, we have now been together for about 3 weeks and last week we dropped I love yous. It is too early?? We are so into each other it's insane. We have the best time together and we just have a connection like no other. When we have sex we are on a whole different planet it's so amazing. I see nothing wrong with saying it this early on but my bestfriend seems to be skeptical. Thoughts?