condom free while on birth control?

hey there, I've been on birth control for about two months now so i think it's working properly. i had some complications with getting unexpected bleeding for days at a time during the first month but it's okay now. i was wondering if i would be okay to have sex without a condom as long as he doesn't finish in me? we've been together for a while and neither of us have STI's so the only protection we need is from pregnancy