Sex 31 weeks

My husband is one of those who thinks it's weird to have sex because the baby is "right there" and the baby can hear. We've had sex a few times during my pregnancy. I try to be available but he never wants to. He's been very open he'll say he's been fine he's okay but last night he said that it's been getting a little hard. I'm definitely going to try and do the deed tonight but of course my hormones. I'm scared it's hard for him to be faithful (never been an issue in the past), this sucks. Has anyone else been stressing or have stressed and their men remain faithful?