Pumping to replace a feed?

Will pumping from both breasts to replace a feed increase my supply or will it do nothing?

I have a slight over supply so I’m trying to avoid making it worse!