Help! How to do anal without it hurting at first?

So my fwb and I have been thinking about doing anal but when I first tried it with the guy I lost my virginity to it was very painful and he had a smaller penis size than my fwb. My fwb is on the bigger size and it scares me a bit that it would be worse. Is there a way that I can do it without it hurting me?