Underwire won't stay flat

I've only recently started wearing underwire bras, so I don't know if it's a normal thing or not. I've worn them for maybe 2 months. I have 2 and they are 34B. The underwires stick out. Not the actual underwire coming out of the bra, at the bottom of my boob where the underwire is, it sticks out, making it so I can't wear tighter shirts because you can see it. It just doesn't stay flat. It's extremely annoying. They also don't stay put, when I move my arms up they move up as well. Once in gym class I was changing and lifted my arms to take off my shirt and the bra went up and.. Yeah. Normally is sits just above where my boob 'starts'. You get the picture. It leaves red marks however and it's really tight. Thanks for any advice!