Roommates

My SO and I are both 30 (ok I'm 31) when we were looking at houses we had a friend (25) who is in Nursing school and needed a place to stay. He was is a bad situation so I told him he could rent a room from us until he graduated next Dec. We found a great house with 5 bedrooms so there was plenty of space. However, right before moving in my SO's brother (29) went thru a very messy break up with his fiancee and is in a very bad place. They split and he needed somewhere to live so naturally and since he is family we offered him a room at our new house. We are coming off of a long distance relationship (WI to CT) and have had some challenges in our relationship. Right now there isn't a problem but I didn't think I'd be living with 3 guys at the age of 30. I love them all to death but am dreading the day I need to bridge the subject for them to move out. I am also getting to the point where I want it to just be us. We've been together for 3 years and will start looking at next steps soon but not with this crowded of a house. I feel completely insensitive. Any constructive advice?