Should I end things with him?

I am at 21F with a 22M and have been going out for 3 years. We don’t live together, I have my own place and he’s soon to be moving out to his own place with his friends as my living situation in the next couple of months are TBD. This week I received a phone call at 10 PM from a high school male friend whom only reaches out to me every couple of months to check up on me and ask how I’m doing. I have not heard of this friend since August when he was taking a road trip with family. I answered the phone questionably asking “hey, what makes for this phone call, i didn’t think we were friends,” and we just caught up and not even 15 minutes later ended the phone call. I’ve also received a text from a female friend at coincidentally the same time and basically told her the same thing about my life as i did to my old high school friend. The next day I call my boyfriend, I tell him about this coincidence and he is very unhappy with me. He claims that I am entertaining this guy and he knows exactly what this guy wants because he himself is a guy. I told him that I didn’t see it that way, but I apologize if it might’ve seemed that way and stated that the friendship I have with this guy is very faint so I do not care to block him just so it wouldn’t be a problem in the future.  I made it clear that my intentions weren’t to entertain him. I even stated back in August that this guy was in a relationship, which he continues to be in and that I am in a relationship. So the respect would be there, I’m also not one to be flirting or entertaining other men. But my boyfriend continues to be adamant about the situation and regardless, if I blocked him, he continues to think that any past fling (in which I haven’t had with this guy from high school)  can call me up, such as an ex, and I’d be answering to entertain them. I’ve blocked my most recent ex a long time ago in the beginnings of our relationship and have no contact with any of my other exes. Why might he think this way? It’s been 3 nights since this incident occurred. My boyfriend has put space in between us as we do not see each other as often anyway, but only calls me once a day to “check up on me” as he still cares about me apparently. But he is no longer interested in having a conversation with me. This breaks my heart because I would like things to go back to normal in which I could call him and we could have a conversatio back-and-forth. I’ve stated this, and we’ve had a long discussion about the situation, but this is what he wants to continue to do. He even asked for me to unshare my location to him as he didn’t want to end up looking at it at random times of the day (i still have his location). Why hasn’t he just broken up with me? Is this situation worth it? I can’t help but to get upset that he still doesn’t want to talk to me as his girlfriend on the phone as we’ve done almost every day for the past 3 years. I am trying to respect him and give him his space in case he decides that he wants to end things with me or to continue the relationship back to how it was. Should I keep waiting or just end things with him?