Ok to not pump at night or only once?

Victoria

So we had to bottle feed my baby for the first 2 weeks of his life because he wouldn’t latch. Then I got a nipple shield and he has been able to and he is now one month old. I still give him a bottle at 11 pm and 4 am because I get frustrated trying to nurse at night.

Will not pumping at night ruin my supply? I sometimes pump at 4 after I wake up more. As of right now I make more than enough milk but my lactation consultant said my supply will drop if I keep this up.

Has anyone else done this? Or if you pump and nurse, what works best for you?