The first time I heard this term was in the movie "Monsters Ball"...
Monster's Ball (2001) - IMDb
It was used by the character "Buck Grotowski" (Peter Boyle), Father of "Hank Grotowski" (Billy Bob Thornton).
Yes it's a racist comment but it's not a common term and that's not how it's been used here.