Does height matter?

Okay :) so my boyfriend and I are almost exactly the same height, and I'm so okay with that. But Saturday is the Air Force military ball, so we went shopping last week. We found a store going out of business, and he found these amazing high heels. They fit like a glove. He told me that they were really really nice, and he didn't care that I would be taller. He really wanted me to buy them. I did. But I feel so so so awkward being THAT much taller then him. Should I ditch the heels and just wear my flats?