Am I harming my baby?

My sleep schedule is all out of whack, I go to bed around 3-4 AM and wake up around 2-3:30 the next day. I usually don't eat from around 11 until I wake up. Am I harming my baby?