Oh god HELP.

I'm sick and tired of having such a hard time brushing my hair after I wash it. It takes me about 20-30 min and I lose so much hair since I get a little rough. But there's no other way! If I'm not rough then my hair will be a completely mess. Note: my hair is naturally straight. Not curly or anything, so that's why I don't understand why the heck I have such a hard time brushing it after I wash it. I bought all kinds of creams to put on it before brushing so it makes it easier but it doesn't seem to work. I feel like I'm going to get bald from all the hair I lose when I brush it. It's ridiculous.