Is cultural appropriation a bad thing?

Is cultural appropriation (the adoption of elements of one culture into another culture) wrong/ a bad thing? Or is it sometimes complimentary?

In the past I’ve thought that cultural appropriation is exploitive and wrong. For example, I wouldn’t rep something with sugar skulls on it because I have no heritage that connects me to Mexico and I feel that would be a misappropriation of culture since I lack any personal connection or understanding of that imagery. However, my husband recently challenged me on this and said “why is it offensive to wear something you find beautiful?” He went on to say that he thinks there’s no instance of cultural appropriation that would offend him, rather, he thinks it should be viewed as complimentary. Someone finding beauty in a culture outside of their own is a good thing.

What do you think? Who do you agree with and why? Does it depend on the specific cultures involved?