Am I wrong

So my ex and babies dad told me to take my son and leave so I took all of my sons stuff and now hes saying he wants the stuff back that I had no right to take it even tho I have him with me