Am I the only one?

My son is five days old and doesn’t sleep through the night but sometimes he seems really well. I set alarms for every three hours for if he doesn’t wake up on his own to eat.. I mostly do this to check on him in general.. I have so much anxiety about him rolling in his sleep or if his swaddle (the halo Velcro) rides up over his face if he moves a lot.. my mother told me I shouldn’t be setting alarms because I need to keep sleeping while I can and that I shouldn’t put myself through that. Am I crazy? Is she right? What’s really the harm in checking on him right? Ugh I just worry