Sugar pill

So I've been on the pill for about 2 weeks and when I started I was supposed to get my period I didn't get it, I thought it was because my body wasn't use to the pill but about 3 day age I had unprotected sex about 3 times and yesterday I started the yellow pill it's my 2nd day taking it but nothing's happening when dose it work or should I be worried?