Bf can’t orgasm

My bf had no problem with cumming from sex while we were still fwb, 5 times a day was not an issue... now that we’re in a relationship, sometimes he can’t orgasm from fcking but only from bj, we are very affectionate otherwise.. he says it’s bc he’s going through a stressful time and that he’s been smoking too much weed and he’s lack of exercise and so on... he ensured that it’s not me... he’s only in his late 20s, should I be worried ? 😔