Partner who is asleep

Me and my husband both love sex, we hardly have it now as we don't see much of each other we will try and get things going when the other is asleep then stop and go sleep then we both end up having sex while sleeping and thinking its a dream... We both laugh at it in the morning... Is it weird?