My son is mad at me after first night CIO?

We tried CIO last very first time and I only went in only once to change his diaper all night. He woke up twice and cried to put himself back to sleep. This morning he was up crying which made me get up. He is usually very cuddly in the morning and wants me to pick him up but not today. He is very distant not smiley and it's making me feel like I am doing something wrong. Is it normal ? Should I not do CIO ?