Can you get pregnant by having sex a day before you period?

So I did the nasty the day I was due to start my period and I was late by 2 days because my hormones were messed with but I've noticed my stomach has gotten bigger. Can you be pregnant by having sex before your period when you're not fertile??