people are telling me i took the pill wrong and might be pregnant

SO, i started birth control this month. i started in the green section on my period (the yellow circle) it’s what i was told to do in the information sheet and by my doctor. i am worried that it’s wrong and that i might be pregnant. my boyfriend came in me on the pink circle. was the pill not active yet? i think we were being really risky and trusting too early. i just feel really dumb and paranoid, i am so worried especially since we get caught up in the moment and don’t use condoms. please help! AND was i supposed to start with the beige tablets on my period, instead of the whites?