Is it weird... I need help

Is it weird that I will soon make 2 years with my boyfriend and we have yet said "I love You" we have talked about it before, and once it slipped out when we were hanging up the phone, he has also told me "te Amo" which is I love you in Spanish, but it was in the middle of the night and we were sleeping and he said it when he hugged me and went back to bed, should I be worried, I mean, I don't know myself if I love him, I kinda hold back since my last relationship of 7 years ended with him saying that he stopped loving me. Also my current boyfriend has said that he believes that the girl should be the first one to say "I love You"