Rich boyfriend

So my boyfriend’s family has a lot of money and don’t get me wrong, my family isn’t poor but my house isn’t as nice as his. He’s coming over tomorrow and I’m just worried that he will look down upon me because my house isn’t very big and it’s not that nice. We have been dating for awhile but he’s just now coming over. Do guys really care about that stuff? I mean he’s dropped me off at my house before and he didn’t care but i don’t know