Ranting about Rocket League's GDC presentation on language ban system.

I will rant about the following video from GDC. Speaker is Devin Connors, community manager of Psyonix. His presentations made me yell to the screen "that proofs nothing!" In the beginning, I was clad that the system seem to only consider cases where the report was filed. This would mean that bar to get banned would be higher because behaviour would have to be worth making a report over. Also, the system did consider the overtime effect by looking at your matches played in one week period. It seems reasonable to consider since a truly toxic player would probably be consistent with toxicity. They also did consider that some players may say "shit", or another curse in a non-toxic context.

Most of my facepalming starts when he talks about "results". Factoids in the slides (relevant here) are

"33% increase in reports received after messaging went live!"

"97000 bans issued in the first 90 days"

The first fact had an assumption that this increase was players who thought reporting system did nothing. That assumption was justified by an anecdote of a player who thinks that the previous system didn't work. How does this show that people weren't just testing the new system for purpose of harassing others? How knows...

The second result is what I have more of a problem with because it is used to justify the whole system as "hey look it works!". THAT IS NOT EVIDENCE OF IT WORKING! Where are your numbers on false positives and negatives? You made a joke about the graphs. Well, where is your ROC-curve? You said in questions that there is a repeal system. How many bans did you repeal?

Also, there were more anecdotes about players coming to Reddit and apology their behaviour. Sheeesh, do people who are banned and angry even go to your subreddit to bitch about it.