Dropped too much too quick!

So I dropped my middle of the night pump and also one pump during the day. At first I was actually making more then all of a sudden  I started to loose 5oz!! So I'm trying to add one more pump back during the day (6 pumps) but it's so hard when the baby won't let me! I was making 40oz and was very happy with that. Advice? How do you find time to get the pumps in during the day? How can I eventually drop pumps? She will be 2 months Saturday.