Confused and unsure

My son likes to dress in my daughters clothes I don't have a problem with that but my partner their step dad doesn't like it and isn't to happy about it I don't understand how to explain to him that kids just like to dress up and the way he acts scares the kids its come to the point that I feel sometimes I need to make a choice I don't want to make but may need to I need advise