Constantly turned down

Alea • 💙Baby boy born March 2018 : Baby girl born September 2019 💜
So with my recent accident things have been off between my SO and me. I try to initiate sex and am always turned down, I asked him about it and he says it's because he doesn't want to hurt me more than I am, I tell him I'm fine but it doesn't change. He just pushes my hand away or rolls over. I'm starting to feel insecure about it but every time I ask now it turns into a fight on how I'm never happy and it's all about sex. And it's not, we are always having fun and doing things together but any time I want sex "that is all I want".