Too much sex...?

How much sex is considered too much??? My boyfriend and I have sex maybe 2 or three times a day. But here is the thing, we only see each other for about 3 or 4 days at a time. Sometimes we don't do anything at all though. He sometimes talks about how he is afraid of "running out of sperm." Or "doing it too much will make him have Erectil disfunction." And to be honest, I've only came because of him like 4 or 5 times in the past 8 months that we have been dating. Am I having too much sex? Any opinions?