He's perfect except.....

I've been in my current relationship for a year and a half. This guy turned everything around for me. I went through a messy divorce after my ex cheated and left, and this guy has been here with me to pick up the pieces and make me smile again.

Honestly, I've never been so happy with someone, loved someone's family so much, or had this kind of sexual chemistry with a partner. Things are perfect with one exception.

He smokes weed, which I did in college (though not remotely as often) but grew out of. I've been waiting on this and talked to his mom about it the other day. It was my talk with her that prompted me to ask him... is this just a phase? Is it something you'll outgrow? He's 27, I'm 28.

I have a daughter who lives across the country with her father but I've wanted to get at least joint custody, but this has been weighing on me. I love this guy, and my daughter does too, but i don't want her around that.

I asked "can you see yourself as a parent, still doing this?" and he said priorities change when you have kids, blah blah. I know that, I have one (which is maybe why this bothers me). I know he wants a family someday and I can't picture my life without him in it, I just don't know what to do.

Wait? How long? He said priorities change but when? Leave him? I'm entirely alone here (no family, few friends) and it would utterly devastate me. Talk to him again about it? Is there something else I should say or phrase differently? Any help would be appreciated. He is a wonderful guy and his family (and me!) are hoping that we're together for the long haul.