Painful anal

Me and my boyfriend have tried anal twice. Once with lube and the other without. But times he's tried it hurt so bad and I couldn't handle it anymore. Does anybody have any advice?