Husband angry at me!

I'm 15 weeks and 2 days. My husband and I are renovating the apartment were moving into. We've had a lot of set backs with painters and tilers canceling on us. So I kept bugging him if I could help someone prime and paint the apartment to get it done for our May 30th move in date. He kept saying he's against me painting, but I did a lot of research and talked to nurse friends of mine who said with good ventilation, a mask, rest breaks, etc. it should be okay. So I went against his wishes and did about 30 minutes of painting with his mom today. When I told him he was furious and then said "if our baby has birth defects it's because of the decisions you've made to work in the apartment even though Ileep asking you not to" He apologized s little while later and said he shouldn't have said that but it hit me like a slap in the face and obviously made me feel like crap. I feel like if anything happens, whether it's preventable or not, it will be my fault. He freaks out about a lot of little stuff, me getting a pedicure, me poking my belly to try and feel my uterus. I know he's feeling really protective and on the one hand I'm glad he's concerned about our wellbeing BUT it felt really harsh. I'd love some honest opinions about this.