Sleeping advice

How would you feel about your little ones sleeping on a different floor level than you? My husband and I have looked at this house that we absolutely love, it's perfect. But the master bedroom is downstairs while the other rooms are upstairs 😕. It does have one room downstairs but it's not considered a bedroom because it has no closet. We have a 1 1/2 year old and pregnant. I just don't know if I'll like my baby's being on a seperate floor, especially upstairs 😟.