Birth control

Is it REALLY that big of a deal if I don’t take my birth control pill at the same time every day? I do literally nothing on a timed schedule and I’m not about to start. I feel like since I have PCOS and it took me 3 years to get pregnant with my first that I will be fine if I just get the pill in daily not worrying too much about the time but Idk some people act like since I had one baby that I’m more likely to get pregnant again and it will be easier but idk if I believe that or not.