Decorating the nursery

Ashley
When is a good time to start setting up & decorating the nursery? I'm 20 weeks and would love to but I'm afraid it's too soon. Does it matter? When did you start?