Category Archives: expert_review

a fork in the road II: shirky on citizendium

Clay Shirky has some interesting thoughts on why Larry Sanger’s expert-driven Wikipedia spinoff Citizendium is bound to fail. At the heart of it is Sanger’s notion of expertise, which is based largely on institutional warrants like academic credentials, yet lacks in Citizendium the institutional framework to effectively impose itself. In other words, experts are “social facts” that rely on culturally manufactured perceptions and deferences, which may not be transferrable to an online project like the Citizendium. Sanger envisions a kind of romance between benevolent academics and an adoring public that feels privileged to take part in a distributed apprenticeship. In reality, Shirky says, this hybrid of Wikipedia-style community and top-down editorial enforcement is likely to collapse under its own contradictions. Shirky:

Citizendium is based less on a system of supportable governance than on the belief that such governance will not be necessary, except in rare cases. Real experts will self-certify; rank-and-file participants will be delighted to work alongside them; when disputes arise, the expert view will prevail; and all of this will proceed under a process that is lightweight and harmonious. All of this will come to naught when the citizens rankle at the reflexive deference to editors; in reaction, they will debauch self-certification…contest expert preogatives, rasing the cost of review to unsupportable levels…take to distributed protest…or simply opt-out.

Shirky makes a point at the end of his essay that I found especially insightful. He compares the “mechanisms of deference” at work in Wikipedia and in the proposed Citizendium. In other words, how in these two systems does consensus crystallize around an editorial action? What makes people say, ok, I defer to that?

The philosophical issue here is one of deference. Citizendium is intended to improve on Wikipedia by adding a mechanism for deference, but Wikipedia already has a mechanism for deference — survival of edits. I recently re-wrote the conceptual recipe for a Menger Sponge, and my edits have survived, so far. The community has deferred not to me, but to my contribution, and that deference is both negative (not edited so far) and provisional (can always be edited.)
Deference, on Citizendium will be for people, not contributions, and will rely on external credentials, a priori certification, and institutional enforcement. Deference, on Wikipedia, is for contributions, not people, and relies on behavior on Wikipedia itself, post hoc examination, and peer-review. Sanger believes that Wikipedia goes too far in its disrespect of experts; what killed Nupedia and will kill Citizendium is that they won’t go far enough.

My only big problem with this piece is that it’s too easy on Wikipedia. Shirky’s primary interest is social software, so the big question for him is whether a system will foster group interaction — Wikipedia’s has proven to do so, and there’s reason to believe that Citizendium’s will not, fair enough. But Shirky doesn’t acknowledge the fact that Wikipedia suffers from some of the same problems that he claims will inevitably plague Citizendium, the most obvious being insularity. Like it or not, there is in Wikipedia de facto top-down control by self-appointed experts: the cliquish inner core of editors that over time has becomes increasingly hard to penetrate. It’s not part of Wikipedia’s policy, it certainly goes against the spirit of the enterprise, but it exists nonetheless. These may not be experts as defined by Sanger, but they certainly are “social facts” within the Wikipedia culture, and they’ve even devised semi-formal credential systems like barnstars to adorn their user profiles and perhaps cow more novice users. I still agree with Shirky’s overall prognosis, but it’s worth thinking about some of the problems that Sanger is trying to address, albeit in a misconceived way.

a fork in the road for wikipedia

Estranged Wikipedia cofounder Larry Sanger has long argued for a more privileged place for experts in the Wikipedia community. Now his dream may finally be realized. A few days ago, he announced a new encyclopedia project that will begin as a “progressive fork” off of the current Wikipedia. Under the terms of the GNU Free Documentation License, anyone is free to reproduce and alter content from Wikipedia on an independent site as long as the new version is made available under those same terms. Like its antecedent, the new Citizendium, or “Citizens’ Compendium”, will rely on volunteers to write and develop articles, but under the direction of self-nominated expert subject editors. Sanger, who currently is in the process of recruiting startup editors and assembling an advisory board, says a beta of the site should be up by the end of the month.

We want the wiki project to be as self-managing as possible. We do not want editors to be selected by a committee, which process is too open to abuse and politics in a radically open and global project like this one is. Instead, we will be posting a list of credentials suitable for editorship. (We have not constructed this list yet, but we will post a draft in the next few weeks. A Ph.D. will be neither necessary nor sufficient for editorship.) Contributors may then look at the list and make the judgment themselves whether, essentially, their CVs qualify them as editors. They may then go to the wiki, place a link to their CV on their user page, and declare themselves to be editors. Since this declaration must be made publicly on the wiki, and credentials must be verifiable online via links on user pages, it will be very easy for the community to spot false claims to editorship.
We will also no doubt need a process where people who do not have the credentials are allowed to become editors, and where (in unusual cases) people who have the credentials are removed as editors. (link)

Initially, this process will be coordinated by “an ad hoc committee of interim chief subject editors.” Eventually, more permanent subject editors will be selected through some as yet to be determined process.
Another big departure from Wikipedia: all authors and editors must be registered under their real name.
More soon…
Reports in Ars Technica and The Register.

who do you trust?

Larry Sanger posted this comment to if:book’s recent Digital Universe and expert review post. In the second paragraph Sanger suggests that experts should not have to constantly prove the value of their expertise. We think this is a crucial question. What do you think?
“In its first year or two it was very much not the case that Wikipedia “only looks at reputation that has been built up within Wikipedia.” We used to show respect to well-qualified people as soon as they showed up. In fact, it’s very sad that it has changed in that way, because that means that Wikipedia has become insular–and it has, too. (And in fact, I warned very specifically against this insularity. I knew it would rear its ugly head unless we worked against it.) Worse, Wikipedia’s notion of expertise depends on how well you work within that system–which has nothing whatsoever to do with how well you know a subject.
“That’s what expertise is, after all: knowing a lot about a subject. It seems that any project in which you have to “prove” that you know a lot about a subject, to people who don’t know a lot about the subject, will endlessly struggle to attract society’s knowledge leaders.”