Dumb Question 🙈 Need Help 🤷🏼‍♂️

So I have been on and off the pill for a while with little problems with it which I am going to the doc to see about but the thing that I was wondering is how long did you guys wait till you let your other have cum in you? Boyfriend and I have been super careful and want to take it further but with having the problems I have had with the pill we are unsure when we can stop with the protection?