bare with me it's a lot!

Well I met this guy we were cooking it. I have him head on the first day and it was fine. He would invite me over for the next two weeks and we just kicked it but in Thursday we actually had sex. It was cool after. He made me food and what not. Then we went to sleep. He held me the whole time etc. then he got up to go to work kissed my head and was going to leave me until I wanted to leave but I ended up getting up to brush my teeth to leave and he hugged me bye and left. We texted immediately after it was fine then he went ghost from 11-3 and texted me back but then age to said my phone was dying I called him at 12 am to see if he was home no answer. But I have trust issues so I feel like he's going to leave like my old flame. I then Texted him this morning saying "I want my stuff to be on my merry way" he FaceTimed me and asked what's wrong with me etc and I said nothing. He said" you sure cause you hit me up talking about being on your merry way like we're arguing or something" I said nah we're good and he was like ok and we had a regular convo and he hung up. I text him after and said my mouth was bruised cause of oral and he said "lmfao" then I told him to have a good day and he didn't say anything back. Like what should I do. Drop him? And move on. We have a date tomorrow and I don't want to ask right now sense he didn't reply. I hope we go on this date. Idk I really like him.