Pregnant & no sex

So I'm 24 weeks pregnant. My significant other and I used to have a pretty decent sex life. Sex at least 5 days a week sometimes multiple times a day, now I'm lucky if it's twice a week. He says it's weird. Which clearly shoots my confidence level down. I'm used to being pretty fit & now that I'm rocking this belly I've lost all confidence. Don't get me wrong I love my bundle, but mentally this body change is taking a toll on me. I've never felt so unattractive in my life. He says he thought it was normal not to have sex when your pregnant & I shouldn't be emotional about it cause I won't be pregnant forever. But its not that easy. Is this normal, why is it affecting my mental so badly.? I don't think I'm that shallow, maybe I am.