AdvancedModeration

This Page is Glorious History!

The content of this page either is bit-rotted, or has lost its reason to exist due to some new features having been implemented in MusicBrainz, or maybe just described something that never made it in (or made it in a different way), or possibly is meant to store information and memories about our Glorious Past.

We still keep this page to honor the brave editors who, during the prehistoric times (prehistoric for you, newcomer!), struggled hard to build a better present and dreamed of an even better future. We also keep it for archival purposes because possibly it still contains crazy thoughts and ideas that may be reused someday. If you're not into looking at either the past or the future, you should just disregard entirely this page content and look for an up to date documentation page elsewhere.

MusicBrainz Wiki Moderation Notes

Tentative Summary

This page seems to mix two things which are now discussed separately. These are the EditorRating and the SurvivalOfTheFittest model.

Motivation

Voting on edits sucks and in recent history we're only averaging a little more than one votes per edit. The editing system itself works, but the voting system could definitely be improved. However, voting is needed since it reviews the changes made by moderators. We should switch to a wiki style editing system that allows people to freely make changes and then allows editors to view edits by:

On top of that we could color code (or different shade gradients) the karma level of each editor. If a editor has a low karma level, their changes would stand out more and get more attention from reviewers. Furthermore, we could send out mail to editors when their 'artists' are changed (this is a pending improvement request already) and when their edits are overturned. This gives a editor a heads-up that their changes are being affected and that they should pay attention.

Editor Karma: The Double Hit Policy

To motivate and reward editors who review other editors' changes, a simple karma system can be employed. An editors karma is a simple number, that gets adjusted according to the following rules:

The idea is to reward people for making changes and undoing bad/malicious changes, while punishing people who make bad/malicious changes or undo other editors good changes. Examine the following scenarios as examples for how this might work:

First scenario: Bad moderator undoes a good moderation
         Good      Bad
    Add    +1            
    Undo   -2       +1
    Redo   +1       -2
    ==================
            0       -1

The good editor comes away unchanged, although they did not get credit for their original addition. The bad editor who undid a good edit now has a worse karma score than when they began.

Some bad editor could launch a smear attack on a good editor. The bad editor can go after the good editor and overturn all their changes. The community would catch this and could agree to banish the bad editor and 'undo' the damage done by the bad editor, thereby restoring the karma of the good editor.

Second Scenario: An editor adds crap to the database to get a better karma rating
          Bad     Good           
    Add    +1            
    Undo   -2       +1
    Redo   +1       -2
    Undo   -2       +1
    ==================
           -2        0

In this scenario the bad editor ends up with a worse karma score as well. Overall, the deck is stacked against editors who attempt to make bad changes and in favor or editors who make good changes.

Created by Johan and RobertKaye

The ideal moderation system is clearly compact: 0 lines of Perl. But because we live in a world were mistakes are made and people abuse systems we need some kind of moderation. Hopefully I will be able to program a new moderation/reputation system that models the three dimensions we also use in the real-world. Such a system has never been proposed in the scientific literature. A good example of a partial implementation is [WWW] http://advogato.org

A good moderation/reputation system should contain in my opinion:

With such a system in place the content on the MB site would need almost no maintenance of editors. People would be free to edit everything. The way that others feel about their edit influences their reputation. More to follow...

Interesting links on this topic:

Johan

Please add your own perfect moderation system description.

CategoryHistory NeedsEditing

last edited 2008-08-01 05:20:27 by voiceinsideyou

MusicBrainz web site  *  Support / Contact