Pill and pull out

I’m a perfect pill taker and my partner pulls out should I be worried?