Bf and smoking

So I am a cannamom, I smoke in the morning after nursing and after kids are in bed. But last night I did my usual and my one year old ended up waking up (he usually sleeps 4-5 hours after I lay him down but didn’t last night) so of course when he woke up he wanted the boob.. I know women who smoke and bf but I’m curious to know if he’ll be ok. Now I’m nervous to do it again