Soft too soon, is this normal?

Me and my boyfriend never have sex for long as he goes soft after one round and it makes him feel really crap, is this normal and is there anything we can do about it?