Husband spending time w baby?

So we are 3 months in and my husband hasn't spent more than 1 hour alone with our baby. He says its bc I am EBF even though I have frozen milk saved up that baby can drink. Also that when they are babies they are only meant to be with mom. I am really struggling as I have not had any alone time since having our baby and I can't plan anything that doesn't involve taking her with me - even therapy that I'm trying to get bc I'm starting to feel depressed, not bc of this, having a lot of family issues w my mother. Any other moms going through the same? Are you the only one that spends time with your baby?