Condom came off in me before he came- should I be worried??

My husband and I were having sex and when we went to switch positions from me being on top I got up and the condom slipped off inside of me. He had not ejaculated yet. We got the condom out of me pretty quickly. Should I be concerned at all about pregnancy?