Except Katniss is from an area where olive skin is much more likely to mean mixed race black and/or Native instead of Mediterranean. There's also the strong context clues of "darker oppressed coal miners, lighter merchant class".

Also, you know, her casting call specified white girls only.