Tips on how to avoid painful anal sex?

My hubby and I have only done anal once, and it scarred me. We used a shit ton of lube, and a condom but for some reason, I was still in so much pain. I tried to relax knowing that he enjoyed it, but it was difficult. It just felt like crap was going back up my arse lol. He wants to do it again, but I'm so scared of it hurting. 😫 Do you ladies have any tips?! (Other than not to do it 😒)