Am I a bad person?

For not wanting to date someone who does drugs? Like I don't judge, people should do what they want as long as they don't harm others but I don't know if I would wanna date someone who does them? Nowadays people are a lot more free and open minded so I feel like a bad person for saying that. Don't get me wrong like I said, people should do what they please and I don't judge them for it. I'm talking to a guy who says he smokes a few times a week. What are your thoughts?