Having sex with condoms?

Right now I cannot get on the pill. If my partner always wears a condom and we are really careful (doesn't finish inside the condom inside me etc..) is it likely ill get pregnant? Am I worrying for no reason?