Postpartum bleedingafter starting the Pill

Ok so Sunday I started taking the mini pill and I was 5 weeks postpartum. My bleeding had almost stopped it was a light brown yellowish discharge. I had sex Wednesday night. Then today I had some red in my pad. Should I be concerned or has anyone else had this?