Rest days

I've gained a lot of weight after having a baby. He is now almost 2 and since the gyms are open. I've been going to the gym 4-5 times a week and there's some days I can't go. Anyways idk if my fiance doesn't want me 5o go but I go early in the morning before they wake up so it's not an inconvenience for him. But he told me I shouldn't be going so much. ( I don't do a lot of cardio exceptfor jumprope, mostly legs and I deadlift,arms, dumbbell, etc). He said I should only be going 3 days out of the week to rest my muscles and said experts have said this. Has anyone heard of this? He said someone told him this a while back. But going back to the gym makes me happy. I like that it keeps me consistent and I do take breaks. So if anyone can give me clarity it would be nice