First time without a condom?

So my boyfriend is the only person I've ever considered not using a condom with and I think I'd like to try it. I'm on the pill (I use Apri) and I take it perfectly. I would want him to pull out too just to add a bit more of security for me but I'd like to know if theres anyone else who goes unprotected on birth control? what are your experiences with it? any recommendations?