Closet Nursery

I really really really want a nursery, but unfortunately my living conditions don't allow me to have one :(. In me and my SO's room there is this huge empty walk in closet(it doesn't have a door) It would easily fit a crib, changing table and dresser. I can picture a tiny nursery in there all ready. The only problem is my SO can't seem to picture it and is super against it. He seems to think DIYing a nursery out of a closet is a terrible idea. What do you guys think?