Annoying husband !

My husband has recently started cholesterol meds and aspirin and sometimes he forgets to take them or he just decides not to take them. Last night he came to me and said I don’t take care of him and that I don’t make sure he takes his medication. Have in mind I have my 10 month old to take care and barely have time for myself and I cook and clean aswell. It gets me really angry when he says things like this because I honestly am mentally exhausted. If I tell him that he should be keeping track or I truly tell him how I feel he’ll start making me feel like it’s my fault. Does anyone have a husband like this ? And if so how the hell do you deal with this shit ?