My Boyfriend Won't Cum

Hey all so I have a bit of an awkward problem I need advice for. My boyfriend and I just recently started having sex with each other and each time he can't seem to cum. He can go for hours which sounds like a godsend and is nice but after a while it's draining. Eventually we just stop and I go down on him to get him off. (2 hours after we started) He has no trouble orgasming that way, or when he jerks off. He says it isn't me but I can't help feeling like I'm doing something wrong. Granted every time we've been having sex it's been late at night due to being busy. Maybe he's just tired? I know for a fact he hasn't had this issue with other girls before. Please help 😩