Baby nursery

Katherine
Ladies I need help. My husband and I are debating about the baby nursery, on weather it's too soon to even think about setting it up. I am only 22 weeks. But we want to start getting ready little by little and not leave anything for last min since we will be the one buying everything. Any one please? Is it too soon? When is the right time ?