Was I in the wrong?

I agree this may be ridiculous but I would like some outside feedback please. My boyfriend and I have just had an argument. We were lying in bed and I was listening to some music and then one of my favourite songs comes on. He tells me to turn it off and then started nagging about it throughout the 3 minute song and then started getting physical. (Twisted my arm). No I wasn't listening to it on repeat, it was the first time he has heard it in possibly a week+. He was studying at the time this argument took place however never had a problem with any of the other songs until this came on. So am I in the wrong or not? Feel free to comment also.