Ummmmmm help

My boyfriend and I are both virgins and today we decided we were ready and we went really slow. After a lot of grinding and some heavy petting we put the condom on and rolled it down but almost as soon as the condom was on his penis went limp. Is this normal? Does anyone know how to make this not happen next time?