Safest sex with being abstinent?

Me and my hubby were thinking that I could go on birth control, use a condom AND withdraw when he ejaculates. Would there still be a high risk of pregnancy?