Allergic to material?

Is it possible to be allergic to the material that your underwear is made of?  I've noticed I get different reactions down there when i wear certain ones. So I'm wondering if it's just me, which it very well could be, or if it's possible I'm allergic. I do have to use hypoallergenic body washes and stuff. So that made me think.