Accutane (acne medication)

So I was taking accutane for 2 years (one year on one year off then on for almost a year) i just recently started having sex with my boyfriend and we were planning on not using condoms any more since they're too hard for us to get and I don't want him to be scared about the even more harsh possibilities of me getting pregnant since some side effects are depression and birth defects (child can be born with one eye, one ear, so on and so forth) so it stays in your system for 3-6 years. Would these add up like since I was not taking the medication for one year that would make it last 2-5 years and since I took another dose it would add together and make it last 5-11 years?? Ik this is hard to understand and I don't want anyone saying anything about me not being able to get condoms easily, isn't this supposed to be non judge mental?? But if anyone can help that would be great! I wanna go on the medication but my boyfriend wants to wait until the medication completely out of my system before having unprotected sex or trying for a child.