Bf frustrated bc I'm on the pill but I still want him to wear a condom

My boyfriend got really frustrated tonight because I asked him "to be safe" and wear a condom. He goes,"but your on the pill! You'll be fine." And we argued on for like 5 min... I feel bad because I am on the pill so there is only a 0.1% chance of getting pregnant but it's still stressful waiting for my period 😓 so I don't know what to do, he said,"it just seems like a chore now instead of fun, there are all these rules" ??? He acted really distant after, and I'm kinda worried about it because he's not like that. What should I do? 😁😓