Need an Opinion

Yesterday my boyfriend and I had sex without a condom. Usually we use a condom, withdrawal and I am on the pill. Things just sort of happened yesterday without a second thought. I am not trying to concieve and I am always careful with only a few of theses moments the past 2 years. I am worried about possibly getting pregnant. Even on the pill.