"Wiggers" Meaning a white person trying to "act" black. By wearing, or talking in slang.

Since when does a certain race get the benifit of wearing a certain type of clothing, or language?

If a white person was to go around, and say "Stop trying to act white, wearing a (for example) Old Navy sweater." That would be racist. See my point?