I just really need someone.

Well my man friend came over tonight and when he got here he had been drinking. Well we watched a movie for a bit then we started fooling around. We went into my bedroom and got pretty intimate. But im 16 and havent lost my virginity. He kept asking if we could have sex and I didnt give him an answer. 15 mins later he asked again and I really really wamted to but I said no.. he left and ran into this huge hole in my backyard and I had to help him get his truck ouy bc my dad didnt know he was here. Then he left. Im super worried that hes mad at me. What do I do. I really like him. Am I just being stupid for telling him im not ready?