Marriage Alternative

My partner and I have made it clear we want to stay together for the rest of our lives, but we're both atheist and agree that "traditional" marriage and its religious origin isnt for us. Is there any other way to be recognized as a couple legally?