can I get my milk back?

So I decided to stop breast feeding and pumping about 2 weeks in because it was too much! I allowed my breast to engorge and slowly go away but I still have a good amount of milk left that is constantly producing... every once in a while I put baby on boob but he doesn't seem to like the anymore he is used to bottle... well I have been receiving so much support to continue breast feeding and now that baby is sleeping more at night I wonder... is it too late to continue breast feeding and is there a way to get my milk supply up??? Ladies any advice?