At the beginning of the story, the four outcasts are labeled as "improper persons." Their initial behavior, with the exception of Oakhurst, shows them as crude, lazy, and frequently drunk. However, Tom and Piney, who come from a different settlement, are unaware of these outcasts' reputations and are not swayed by Poker Flat's prejudices. Tom had a brief encounter with Oakhurst before and found him to be kind and gentlemanly, so he treats him as such rather than seeing him as a questionable gambler. The young couple mistakenly assumes that the prostitute Duchess is "Mrs. Oakhurst," and Piney envisions that the women from Poker Flat are of high social status and "used to fine things."

The difference between appearance and reality becomes most apparent when the group is trapped in a snowstorm. Mother Shipton, who might indeed be a madam, shows her compassion and bravery by sacrificing her life to save Piney. Similarly, Duchess, the "soiled sister," becomes a companion and protector for Piney. By the end of the story, it becomes impossible to tell "which was she that had sinned." Oakhurst, who appeared the most composed during the crisis, ultimately cannot withstand the harsh conditions and takes his own life. Throughout the narrative, Harte demonstrates that human nature is often more complex than it appears.