Help please!!!

So I have been fucking around with this guy for awhile now. We started off as just friends with benefits but he has feelings for me now. I told him no and we shouldn’t see each other anymore because I got out of a relationship a couple weeks before getting with him and really didn’t want to get into another one. I stayed his friend though and we still fuck sometimes but now I have gotten feeling for him. He is so sweet to me and always wants to see me and makes me laugh but he is very sensitive so if I say something kinda sassy he will pout forever. Also I am very against drugs and smoking and drinking but he smokes weed and when I said I wouldn’t date a guy that smoked he freaked out and said he wouldn’t stop smoking for a girl and we should just fuck and the only time we should talk is when asking the other for sex. I told him to leave me alone but he apologized and had been buying me food and he walked my hair and is acting very sweet. I don’t know what to do. I like this guy but he smokes. Should I date him anyway or stick with my ways and not date a man who smokes?