Am I just paranoid

I just moved into a duplex with apartment buildings next to us (same property owners) I have my medical card but they kicked someone out from smoking marijuana because it was “disturbing the peace” but their lease doesn’t have anything about marijuana in it. If I smoke outside, will the smoke go into the buildings next to me if their windows are open? Where should I go without feeling so paranoid