Taking bottle but not breast?

Today my baby has been pretty fussy. When I tried nursing him a little while ago, he was refusing to eat. He hasn’t eaten in around 2.5 hours so I knew he had to be hungry. After trying to get him to nurse for a half hour, I decided to try and warm up some of the milk I have in the freezer. Well he took the bottle right away and drank 2 whole oz in a matter of 10 minutes.

Is my supply down? I pump every time he gets a bottle. Are there any ways to quickly get my supply up? I only pump once in the morning so I have milk for my husband when I go to the gym and then I pump if he gives him a bottle besides that he never gets one.