Can you rebuild your milk up ?

I’m 2weeks pp and I haven’t been pumping like I should and baby was not latching so I’ve just been pumping and supplements. for a minute I had got ok with just doing supplements but I really just want baby to have my breast milk only. but since I’m not doing it as often I notice today my milk supply has decreased a lot!. Is it to late to try and build it back up ?? Even if I can’t get baby to latch I still want her to get my breast milk I’ve brought mother milk tea today to try and increase it but I’m scared it’s to late...any advice for a first time momma ?