Decreased libido

So my husband and I are on different “time zones” you could say with sex. When I want it he doesn’t and vice versa. I was raped the first tome I had sex so it’s never something we pushed but we will be trying soon for a baby and I feel sooooo unattractive. He says it has nothing to do with me but my confidence is down so much and I’m sure that doesn’t help. Tips? Words of encouragement?