Height Problems

So homecoming is in a couple weeks and I'm going with my boyfriend of 3 months. I ordered the perfect outfit online and I'm honestly in love with my shoes and dress. Only problem is that the 3 inch heels will make me 1/2 inch taller than my bf..... He says he doesn't mind but I can't help but feel he said that just to be nice. Do guys really care about the height thing? Should I exchange the shoes?