Can’t cum

I’ve been with my boyfriend for 4 months now as we have only had sex 5 times. Every time he doesn’t cum we even do foreplay before to get in the mood but never manages too. I don’t want to say anything as makes it awkward but am I the problem? It puts me off having sex and always say no as it’s embarrassing that I can’t make him cum