pill and sex

about three weeks ago my boyfriend and i had sex and he wasn't wearing a condom. i've been on birth control for 4 years. he didn't finish AT ALL because we stopped. i'm freaking out. opinions?