My husband’s masturbating is affecting our sex life

Hi! I have previously had issues with my husband masturbating. It doesn’t bother me if he does it and I know it’s normal and natural, but if he does it in the morning and then is too tired to have wax with me at night I get frustrated. Anyone else dealing with this? When I speak to him about it he thinks he’s doing nothing wrong. But for me sex is a way of connecting and feeling close to him. If he pleasures himself and gets what he needs, should I just do the same? Won’t we just grow apart in that case?

Help!