Not feeling baby!

I'm 22 weeks pregnant as of yesterday and I haven't felt baby in 3 days. I had an ultrasound Monday baby was perfect, I actually felt him kick for 2 days straight and then nothing. I have a fetal doppler and I have checked heart beat past 2 days and it sounds good I think. Before Monday's ultrasound I barely felt him but I would feel butterflies and tiny kicks here and there but this past 3 days nothing at all. I called my on call obgyn yesterday and he said, it's unpredictable at 22 weeks if they move or not but only go to ER if bleeding or cramping. And he said that even if something did happen there is nothing that can be done since it's still not a viable pregnancy. I'm freaking out, is this normal? should I go to ER?