first 'I love you'

So I've been seeing this guy for quite a few months, but we are not actually in a relationship but speak everyday and I stay round his when he has days off but I'm confused I don't know  where I stand... He told me the other day he loved me.. Like we was in bed just woke up still sleepy and he whispered I love you in my ear but I didn't believe and was like course you don't and he was like well I said it didn't I and I had a massive grin on my face and he asked if I loved him and I said course I do then he said say it then... So I did, it was kinda a big deal for me but then he hasn't mentioned it since and I text him saying 'I love you xxxx' and he completely pied me off 😂 he was just like 'where'd that come from xxxx' and I say I don't know then he just said 'cutie 😊 xxxx' like he didn't say it back.. How awkward 😳 just need advice or people's opinions?