When he goes soft

Me and the guy I'm seeing have been having sex for about a month or so now, and quite often. Everything has gone great sexually up until last night and this morning when he went soft both times. Last night I was able to eventually finish him off but this morning it just wasn't happening. Is it me? I somewhat feel embarrassed about it