Boyfriend is uncomfortable with my family..

So my boyfriend and I have been together for almost 2 years. I was adopted when I was 6 because my biological mother is an alcoholic and my father felt she wasn't a fit enough mom for me so he took me on his own and we lived in a cab for 4 years and he raised me till I met my other mom who raised me. Anyway, I have 2 different family's my adopted mothers german side of the family and my fathers chinese side of the family. Well, my boyfriend says he feels uncomfortable being around my dads side and I'm not sure why. But I am also uncomfortable with his family because they are so loud and obnoxious lol but they make me laugh. How can I get my boyfriend to open up more and not feel so uncomfortable???