Scared of postpartum pregnancy

I am 6 weeks pp got the okay to have sex again so last night me and hubby had sex and the condom broke ripped I don’t know. Point is sperm was not in the condom when he pulled it out. I’m freaking out and he’s just like relax my love nothing is going to happen and if it does it’s another blessing. I agree it’s a blessing but not this soon. I stopped bleeding around 3 weeks and half and exclusively breastfeeding.