I need help... again...

I am so in love with this man... and he loves me... but he fucking sucks at showing it and I don't know what to do or how to react... he only takes me out on Fridays and any other time I want to hang out I have to initiate it... he never asks if I want to come over on a whim, it's like pulling teeth to get him to come to my house. I'll invite him, then he never gives me an answer as to whether or not he's coming, so I stay up and wait, then he texts me that he's going to bed... and then I cry... I've tried talking to him about it, but nothing changes... part of me says I should end it and give him a reality check, but I'm so afraid he'll just let me go and he won't fight for me... the other part of me loves him too much... what should I do???