Neglectful wife(long post)

Last night my husband came upstairs and I was grumpy because my dog peed and I stepped in it so I was huffing and puffing about it. He was bringing me water. Then he told me "I was going to come upstairs and have sex but you're in a bad mood and now I'm not in the mood." I apologized and then got upset because he told me that hes used to not getting any. Not super relevant but I am 23 weeks pregnant. I told him it hurts my feelings when he said it and he told me that he just wont say anything anymore. Then I got upset and he told me that he always instigates sex with me and that I never really do and its starting to make him feel like I am not attracted to him as much anymore, I told him that I say all the time that he is handsome and sexy and that I want him all the time but I dont feel attractive, or I dont wanna get rejected, or dont know when the right time is to instigate it. All excuses from me is what it sounds like. I wanted to break down. I feel so horrible that because I haven't instigated anything and that he tells me all the time now beautiful I am but yet I cant for some reason just go up and kiss him passionately or anything. The sex we have is amazing, and when we first got together we constantly were doing it. I dont know what's wrong with me. My last pregnancy we did it constantly, this one I just make no effort and have instigated it 2 times and him the rest of the time. Even during the almost 2 years since my son was born I do hardly anything. I wish I could figure out what is going on. My husband has been nothing but faithful to me and has never cheated. I am worried that I am making him depressed. Help, I need some serious advice. I've been with him almost 4 years come end of August and married for 2 years come july.