how much sex is normal?

So I have been dealing with some clinical anxiety stress issues for a while now and it's messing up my periods and my sex drive. Of all the problems it's caused, the decreased sex drive is the least of my worries, but my boyfriend is almost annoyingly concerned about it... how little sex should we be having for it to be a "real problem"??