Have you experienced a different you? Based on whom you are around? This is not common, but rather un-common among the common and very common among the un-common. The un-common would be rh-negative people.
To make it even clearer:
If the ones labeling you are the reason you are quiet to begin with, you are deep in it. Free yourselves!