Am I wrong or is he wrong?

I cleaned our room and moved things around to make more room and I so happen to move my boyfriends basket and he has two baskets so I moved them next to each other. He got mad at me for not telling him and that he put his dirty laundry in his clean basket. They aren’t identical. I told him I should’ve told him but he could’ve also know better which basket is clean and what’s dirty. He said it’s my fault he put his laundry in the wrong basket. Maybe I’m wrong. But it sounds silly that I’m in the wrong when he’s the one who put his clothes in the wrong basket. They aren’t identical and if anyone knows which basket is clean and dirty it would be him. But apparently I’m wrong and maybe I am.