Advise? For labor an family!

Jessica
So for my first labor my sister came to visit me because she was still in town and werent leaving for another day, luckily my son came just in time for her visit!  Problem is she had two girls, one was 1 1/2ish and other was 4 1/2ish! My husband was so uncomfortable bc they were young an he was our first and the girls wanted to be in his face and try and hold!  
I get it that some love family in there an the kids touching and all but we dont, and he was more against it! Thing was, i had to hurt my sisters feelings an say the girls couldnt come back for a second visit with him! 2 years later an im pregnant again and she did mention maybe we wont be allowed to come for this one too,  how do i handle this situation without hurting feelings? I mean our child is one thing but others?