Bad for me?

So this past summer I met this guy and we started off as friends. At least I didn't really think that he could possibly be in to me. Him and I, as well as a bunch of friends, took a trip together for July 4th, and we were really hitting it off all day. We went out, got drunk, and ended up in bed together. Since then, we've been talking on and off and we really get along pretty well. We've slept together a couple of times after that. I can't tell if we really do have a real connection or not. He says that he really enjoys being with me and that this was a great summer for him and that he is really glad he met me, even though we are now about 7 hours apart. We still talk, and I do like him, but I'm not sure if we could date. We aren't completely compatible in certain areas, honestly I'm not sure if it's just the sex that's great. There are habits of his that I'm fine with now because we're friends, but don't think I could tolerate if we were together. We come from completely different family and religious backgrounds. He's a bit of a bad boy. Pretty much, I don't know if we could work it out. I wouldn't want him to change for me and I don't want to change for him. Is he bad for me? Should we just continue being friends so we don't mess up what we have together? Help!