my man troubles ☹️

I've been with someone from the start of the year. I've had sex with him and I can honestly say I love him. Yet he's not my boyfriend and I want him to be. Everytime I bring it up he says stuff like oh you need to prove it to me in the talking stage, or I don't like putting labels on things, or I don't want to rush into anything. Yet he says stuff like I am his girl and we basically are in a relationship. But because we aren't I'm mistrusting him and don't know what to think- can someone help me  what to do cause I don't want to keep going on about it cause I'll sound needy and also I haven't brought it up in a while cause I'm trying to show him I'm unbothered by it cause it annoys him when I'm going on about it