Inverted Nipples

So I have slightly inverted nipples, like they just don't get very pointy when they're "hard" and they kind of scrunch up, I think that's the way to describe it. But I've only had sex with one guy and I haven't taken off my bra around him because I'm embarrassed for him to see my nipples. I feel like it might be a turn off...? Is it something I should be embarrassed and worried about?