Anal: good or bad overall?

My boyfriend recently told me he'd like to try anal stuff with me and while I have no problem pleasure-wise with it, I'm concerned about possible medical issues that might come up because of anal sex/activities. Even anal sex with a condom seems like it'll end badly because won't there be feces or something on the condom when he pulls out? I'm worried but I wanna explore our sex life. :/