One day of clomid

I took one pill for the first time, supposed to take 5 total but, I changed my mind about it and want to try and conceive naturally still. If I decide that I want to take it later in life, would I be immune to it since I stopped taking it?