Storing Breastmilk

My husband and I went to dinner and I pumped a 5 oz bottle. I know you can keep a bottle in room temperature for 4-6 hours. I never ended up needing to use the bottle because she slept straight through dinner. My question is: can I refrigerate milk after it had sat in room temperature for a few hours??