What do I do next?

My fiancé and I tried to get pregnant for almost a year when we finally got pregnant, then I miscarried 2 months into it. He has been wanting to try and then not try off and on since then, I finally told him we either need to be trying or be completely done trying because I can’t keep doing this back and forth thing. He thought about it for a while and decided that we should be done trying period. I am going to call my doctors office on Tuesday to make an appointment but what are some options for females to prevent pregnancy beside birth control? I am wanting a permanent solution.

Also did anyone ever do something like this and then regret it later in life?