concerned about pregnancy

my boyfriend doesn’t like condoms but i’m on the pill and it takes a while for him to so we finish way before he does anything. should i still be worried?