Supplementing night time bottles

So I recently started mixing my babies two night time bottles with half formula half breast milk. It’s been 4 days and he is constipated. Do I stop the formula or let his stomach adjust to it? I’ve never supplemented before so I have no idea