periods related to sex??

Hi guys I hope this isnt a stupid question but for the most part I have regular periods, once I had thought I might be pregnate(false 🙁) because I was 4 days late a few months back. But my concern is, recently on months that I've had sex near/on my ovulation date my periods have been coming 3-4 days early. Is that something I should be worried about?? Is there a chance that I am actually conceiving but then my body is just rejecting it or the egg isn't sticking(I have a thin uterus wall)?