Anal sex-why is there such a negative stigma?

I completely understand that there are dangers to it, but why is everyone so against it. I've been with my boyfriend for 3+ years and we have anal sex regularly, actually more often than vaginal. I just want to know why everyone is so against it and gives it such a bad name.