Insensitive or no??

One of my twins is having difficulties growing and my spouse read that refraining from sex might help things get better... true or not, doesn't matter he mentioned it to me.. so now we're not having sex (few days now) and he keeps saying things that make it seem like I'm depriving him..  how the hell did me being a concerned FT mom make me the bad  guy??