Do you say I love you

When me and my bf argue i like to be left alone when im upset hell come in or call randomly and say i love you. Now although i love him i hate to say it when im mad, is it bad to not say it back, i feel he knows i do but says it cause if i say it back he believes im not mad anymore