how can i get my SO last name ?

so we plan not to have a wedding . nor a court wedding . we have no supportative family. We are both 29. Do we have to get our marriages licenses for me to get his last name? Or how do i go about that? do we sign papers and we are married? Like i said we just want to get it over with and sign. no wedding no nothing.