Exercise

So I'm what you can call underweight but I've been gaining some weight in my lower belly that I want to lose so I was wondering would exercising make it go away cause I don't like how it looks. Also if it goes away I will obviously lose some more weight so should i leave it and let my body even everything out or should I take care of it myself?