Nuvaring and sex

I find it uncomfortable having sex with the ring in. So each time me and my boyfriend have sex I always take it out. I always put it back in right after we get done and after I go to the bathroom. Which is never longer than 3 hours. Is that okay to do?