Breastfeeding babies

I have a 2 week old that i breastfed. He's been spitting up milk after every fed I don't know if he over eats or this is normal. He eats just fine but he just spits up a lot and prior to him throwing/spitting up he'll cry like he's in pain. Also he hasn't pooped in two days again. The last two days a nurse told me to give him alil bit of olive oil if that doesn't work try alil piece of soap up his butt this made him go instantly but now he hasn't gone again is it safe to repeat this again. He had a dr apt today but we live in southwest fl and due to the hurricane we and the dr offices don't have power. 😞 I don't know what to do it hurts me to hear him cry in out in pain and I can't do anything