More I breastfeed less I make for backup...

Erica
Hello, so I have to use a nipple shield when I feed my little man since he has trouble latching, I've tried breastfeeding him more lately instead of giving him a backup bottle, but lately it seems the more I breastfeed him the less I make when I pump... Is that normal? Any advice?? I pump about 4-5 times a day