Is your husband/boyfriend too big for anal?

The thought of anal really turns me on but my husband has a fairly large penis and it hurts soooooo much. Any one else have trouble?