Period sex

I'm not on birth control and my fiancé has been cumming inside me every time we have sex while I'm on my period, but never while I'm not he always pulls out..is there a high risk of getting pregnant this way?