Who's in the wrong?!

My boyfriend had his two year over yesterday. I didn't mind, but he's at the age where he is very curious. I had taken my dad's ashes and set the on the coffee table. He had a box because I hadn't gotten the urn yet. Well his two year old took the box and knocked it off the table! The ashes where still in a bad so nothing really spilled. I freaked and told my boyfriend to take his son home. He said it's MY fault for putting it in reach of a two year old. I yelled at him for being so insensitive and said if that's the case his son can't come back over. Then we fought about that. He should be teaching his son not to touch things that aren't his! He won't even talk to me. I feel I am right. That is my father!