Alex without condoms

I am in an almost two year monogamous relationship with my partner and we are thinking about having sex sans condoms more often (we have done it twice before). I had used the Today sponge when he did it previously. It was fine and I am also on the pill. I was just wondering if there were other options that might offer more protection. Thanks!