If I say something I seem "crazy" but if I don't I'm just invalidating my own feelings

In general I feel hesitant to voice my feelings about things cause I worry I won't be taken seriously. For example, I get upset when someone doesn't respond to my texts for hours. Then when they respond I feel like I'm crazy for being upset about it. And sometimes I try to calmly or cooly express my feelings (so I don't sound mean or rude) but it just comes out passive aggressive. So a lot of the time I just don't say anything and then feel like a doormat. Does this happen for anyone else?