My little man (4 weeks) will fall asleep without a swaddle but he always seems to wake himself up shortly after because his hands are in his face or he's "startling". Does anyonr else have this problem? I don't want to swaddle him if I don't have to because he gets so warm but I feel like maybe I don't have a choice?