Back to work and baby refusing bottle

Hey mamas, I’m at my wits end. I’ve ordered bottle after bottle but baby boy refuses to eat while I am away from him at work. He’s exclusively breastfeeding. I’m now worried that he will lose weight. He has poopy diapers and pee pee diapers during the day. For instance, he nursed this morning last between 5am-6am. He got home at 7 and my husband said he has only had about 5 ounces all day. This breaks my heart. Please help me with any kind of advice. He’s attached to me as we speak. I’m going to let him nurse as long as he likes.