Why is this filtered

[queenkoopa8500]

I genuinely dont understand why africans is censored
What if somebody said for example "Me and my friends are africans"

[queenkoopa8500]

Or im just dumb and dont understand why its censored lol

[finnbear]

Why is this filtered

The vast majority of things on the wordlist are there because I noticed an inappropriate message and added to the wordlist to prevent an equivalent or similar message in the future. I also try to limit false positives when possible.

The plural form of a demographic can be used to communicate harmful stereotypes (I probably saw at least one message of this category). Note that the 1 in profanity.csv corresponds to Type::MILD. Here are the docs of that (emphasis mine):

Not that bad. (low severity and/or low confidence)

Here, "low confidence" applies. The filter is saying it has a low, but non-negligible, confidence that messages containing "africans" are offensive. What you do with that information is up to you. You could, for example, only restrict when a message is moderately or severely, but not merely mildly, offensive.

---

Note:

• Right now, the filter is optimized for in-game chat, which limits the topics that non-offensive message typically cover.
• (Expanded dynamic range for severity levels #35, Separate severity from confidence level #36) The mild-moderate-severe scale is a bit vague and has insufficient dynamic range. A better scale might involve, for example, 5 levels of severity and (independently) 5 levels of confidence. I want to do this in the future.
• (Symbollic profanity detection #37) Another thing that would help is if the filter supported symbolic profanity like <plural-demographic> are <insult>, so innocent uses of demographic nouns wouldn't be detected.

[finnbear]

"Me and my friends are africans"

I'd definitely accept a PR that added "are africans" to dictionary_extra.txt, which would stop this sentence from being detected.

(note: also applies to "asians", etc.)

[queenkoopa8500]

I'll add it to dictionary extra in a new pr

[queenkoopa8500]

"Me and my friends are africans"

I'd definitely accept a PR that added "are africans" to dictionary_extra.txt, which would stop this sentence from being detected.

(note: also applies to "asians", etc.)

Moving this to #38