Sex help

I haven’t done it but I really want to. Is it wrong to do it with someone I’m not dating. My family always thought me to never do it before marriage but my brothers do all the time and no one ever cares. Then for me they would act like it would be the end of the world.