When to take baby out alone?

My LO is 4 weeks old and the only time I take her out is over the weekends with my husband or on his days off.

I took her out for a walk once by myself but she woke up and started crying and I panicked (I’m a ftm with anxiety).

Is it ok that I’m not confident enough yet to take her out alone? When will it get easier to take her out without the danger of random fussing?

Does it get easier? I just feel overwhelmed and also don’t want to coop her up in the house all the time every day.