Are we crazy?

I'm a college student, and I don't get to see my boyfriend as often as I would like. He comes down every other weekend. |&| yes we get it on. But it seems like when we separate every time. Shortly into the week we start arguing or fighting. He says it may be the sex, I have no idea what to blame. Any ideas?