4 month old attachment issues?

I have a question. My little guy has been impossible to bring out of the house lately! There have been three recent times where my boyfriend and I have taken him to a family members house separately (that has some familiar people and some not) and he has been inconsolable! He screams to the point of throwing up. Is it normal for them to be this easily overstimulated? Do you think it’s because he is so used to both parents being present and we have been doing this separately? I will mention this to his pediatrician but I’m in the process of switching doctors because I don’t trust his current one. Just wondering if this is normal? I’m worried there is something wrong with his development. I know that sounds over the top...