Scares to have sex

I'm worried to have sex again because when we did last week I bled. Not bright red, that sorta brownish color from implantation and it lasted for a couple of days. The GYN told me to hold off but didn't give me a specific time. I haven't bled in about 5 days, but I'm still a bit nervewracked. Anyone else?