What to do?

So there's this guy I'm friends with and he has a girlfriend that is long distance and he says they're not exclusive. He wants to start dating me but not get serious. I'm ok with casual sex but the girlfriend thing is making me uneasy. I do not want to get into that kind of mess. Also I've been ill lately and had to cancel some of our plans and he's been upset about that too. He says he understands but how can you understand and still be upset? :/ So the question is, is it possible to stay friends with someone like this? Should I even?