Behavior?

Can I get some thoughts? My boyfriend and I were watching HIMYM and it had to do with something about your friends talking or saying shit about your partner/lover/SO.... so last night I asked my boyfriend if any of his friends have and he told me that nothing bad has been said about me but they comment on with my “behavior” and can tell my diagnosis. I have autism and there’s no shame or anything cause they like me and think I’m great. But….that makes me incredibly self conscious, is it understandable that I do? Anyone ever felt this way? What should I do?