Taking 2 month old out

Is it ok if I dress my two month old really warm to go out to a couple stores today? I just don’t know if it’s too cold or not.. it’ll be around 43 degrees. We’re just going in and out. Idk I’m a first time mom and just don’t know if I’m being too paranoid lol. She will be in her stroller covered up as well. Dying to get out of the house.. but not sure 🤷🏼‍♀️