Nicu moms

So, my son is 2 weeks old, still in the nicu. I go up there to see him every day, I usually stay anywhere between 1-3 hours. Depends on if I get to hold him or not well sometimes I feel bad when I don't stay that long because I feel like the nurses look at me like I'm a bad mom, I feel bad for leaving him .. Like today when I got there I got there right after they fed him so they didn't want to take him out so I couldn't hold him so I stayed for like 45 minutes and when I left I feel like they look at me like wondering why I don't stay longer. Its just hard on days like today when I can't hold him. Any other moms can relate ? I know it sounds dumb but I just can't help but feel like that sometimes