EBF and baby gets fussy when I'm not with him him

9 months EBF and my lo gets fussy every time I'm not with him. I work part time (weekends) and he can't stand being without me 😭😭😭.  I pump and leave him some milk and whenever there's no breast milk , he eats formula with no problem. But there's some days he can't handle bring without me. It's kind of frustrating that I can't leave him with my husband, my mil or even my mom. Im thinking I should quit my job 😩. Second to last semester of colllege and he gives me hard time doing my hw. Any suggestions? I love my baby but I wish he could be happy without me , don't get me wrong. Thanks in advance