User:Daniel Mietchen/Sandbox/Open Knowledge Conference 2010: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Daniel Mietchen
imported>Daniel Mietchen
(updated)
 
(28 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Background==
This document hosts a contribution to the [[Open Knowledge Conference]] 2010.
Style as per [http://www.springer.com/computer/lncs?SGWID=0-164-6-793341-0 http://www.springer.com/computer/lncs?SGWID=0-164-6-793341-0].
[[LaTeX]] source of the [http://ff.im/ivdlP submitted version] is pasted in below.


This document shall help the drafting of a "full paper" (meaning 15 min of talk on the basis of "5-10 pages describing novel strategies, tools, services or best-practices related to open knowledge") for the [http://www.okfn.org/okcon/cfp/ Open Knowledge Conference (OKCon) 2010]. Submission deadline for the abstract: Jan 31, 2010. Our abstract has been accepted. Feel free to edit as you see fit. For discussion, please use [http://forum.citizendium.org/index.php/topic,2982.0.html this forum thread].
<pre>


Deadline for submission of full paper: March 31, 2010.
%%%%%%%%%%%%%%%%%%%%%%% file typeinst.tex %%%%%%%%%%%%%%%%%%%%%%%%%
%
% This is the LaTeX source for the instructions to authors using
% the LaTeX document class 'llncs.cls' for contributions to
% the Lecture Notes in Computer Sciences series.
% http://www.springer.com/lncs      Springer Heidelberg 2006/05/04
%
% It may be used as a template for your own input - copy it
% to a new file with a new name and use it as the basis
% for your article.
%
% NB: the document class 'llncs' has its own and detailed documentation, see
% ftp://ftp.springer.de/data/pubftp/pub/tex/latex/llncs/latex2e/llncsdoc.pdf
%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%


The presentation will be given by [[User:Tom Morris|Tom Morris]], but everyone is invited to chime in on the drafting. It is intended to reuse much of this material for improving our [[Citizendium]] entry.


==Key issues==
\documentclass[runningheads,a4paper]{llncs}
''This section is auxiliary to the drafting process and will be deleted when the draft is nearing completion.''
Let's concentrate on the following areas from the call for proposals:
  •  Platforms, methods and tools for creating, sharing and curating open knowledge
  •  Open educational tools and resources
  •  Supporting scientific workflows with open knowledge models
hence: 
* Citizendium as
  • a platform for creating, sharing, curating and navigating open knowledge
  • an Open educational tool and resource
  • an open knowledge model supporting professional workflows
  • a democratic and meritocratic community


===Technical details===
\usepackage{amssymb}
\setcounter{tocdepth}{3}
\usepackage{graphicx}


All authors of OKCon papers:
\usepackage{url}
\urldef{\mailsa}\path|{alfred.hofmann, ursula.barth, ingrid.haas, frank.holzwarth,|
\urldef{\mailsb}\path|anna.kramer, leonie.kunz, christine.reiss, nicole.sator,|
\urldef{\mailsc}\path|erika.siebert-cole, peter.strasser, lncs}@springer.com|   
\newcommand{\keywords}[1]{\par\addvspace\baselineskip
\noindent\keywordname\enspace\ignorespaces#1}


• Can submit a camera ready version of the paper in LNCS style [1] for  publication in the online proceedings e.g. till March 31st, to the  proceedings editor: Claudia Muller-Birn <clmb@cs.cmu.edu>
\begin{document}


[1] http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0%20LNCS%20Style
\hyphenation{wiki-space}


Please also note there is no page restriction in place on your papers for this process.
\mainmatter % start of an individual contribution


The final typesetting in [[LaTeX]] will be done by [[User:Daniel Mietchen|Daniel Mietchen]].
% first the title is needed
\title{Collaborative Structuring of Knowledge\\ by Experts and the Public}


==Title==
% a short form should be given in case it is too long for the running head
''Choose one.''
\titlerunning{Collaborative Structuring of Knowledge by Experts and the Public}


#Public and experts working together: an experiment in structuring (disseminating?) knowledge
% the name(s) of the author(s) follow(s) next
#Structuring knowledge for and with both the public and experts
%
#Collaborative structuring of knowledge by experts and the public
% NB: Chinese authors should write their first names(s) in front of
#Knowledge structuring for and by the public in collaboration with experts
% their surnames. This ensures that the names appear correctly in
% the running heads and the author index.
%
\author{Tom Morris\inst{1}%
%\thanks{Please note that the LNCS Editorial assumes that all authors have used
%the western naming convention, with given names preceding surnames. This determines
%the structure of the names in the running heads and the author index.}%
\and Daniel Mietchen\inst{2}}
%
\authorrunning{Tom Morris and Daniel Mietchen}


==Abstract==
% the affiliations are given next; don't give your e-mail address
''The abstract should consist of no more than 200 words.''
% unless you accept that it will be published
\institute{\url{http://www.citizendium.org/User:Tom_Morris}
\and
\url{http://www.citizendium.org/User:Daniel_Mietchen}\\Correspondence: Daniel.Mietchen (at) uni-jena (dot) de }


There is much debate on how public participation and expertise can be brought together in collaborative knowledge environments. One of the experiments addressing the issue directly is Citizendium. In seeking to harvest the strengths (and avoiding the major pitfalls) of both user-generated wiki projects and traditional expert-approved reference works, it is a wiki to which anybody can contribute using their real names, while those with specific expertise are given a special role in assessing the quality of content. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates. We provide an overview of how Citizendium is structured and what it offers to the open knowledge communities, particularly to those engaged in education and research. Special attention will be paid to the structures and processes put in place to provide for transparent governance, to encourage collaboration, to resolve disputes in a civil manner and by taking into account expert opinions, and to facilitate navigation of the site and contextualization of its contents.
%\institute{Springer-Verlag, Computer Science Editorial,\\
%Tiergartenstr. 17, 69121 Heidelberg, Germany\\
%\mailsa\\
%\mailsb\\
%\mailsc\\
%\url{http://www.citizendium.org/User:Tom_Morris}}
%\url{http://www.citizendium.org/User:Tom_Morris\\http://www.citizendium.org/User:Daniel_Mietchen\\}}


== Introduction ==
%
<blockquote> ''Science is already a wiki if you look at it a certain way. It's just a highly inefficient one -- the incremental edits are made in papers instead of wikispace, and significant effort is expended to recapitulate existing knowledge in a paper in order to support the one to three new assertions made in any one paper.'' (John Wilbanks) </blockquote>
% NB: a more complex sample for affiliations and the mapping to the
% corresponding authors can be found in the file "llncs.dem"
% (search for the string "\mainmatter" where a contribution starts).
% "llncs.dem" accompanies the document class "llncs.cls".
%


There are many ways to structure knowledge. One is via coordinated cellular activity in your brain. Others may involve spatial arrangements of sheets of paper or numeric arrangements of digital documents. Here, we will focus on the latter, and even there, a multitude of approaches are possible, of which only a limited number have been tried on a larger scale. Amongst those are wikis, which allow to aggregate and inter-link diverse sets of knowledge in an online-accessible manner, typically in an Open Access manner, i.e. with no costs to the reader.
\toctitle{Collaborative Structuring of Knowledge by Experts and the Public}
\tocauthor{Tom Morris and Daniel Mietchen}
\maketitle


==  Wikis as an example of public knowledge environments online ==


As implied by the introductory quote, it is probably fair to say that turning science (or any system of knowledge production, for that matter) into a wiki (or a set of interlinked collaborative platforms) would make research, teaching and outreach much more transparent, less prone to hype, and more efficient. Just imagine you had a time slider and could watch the history of research on general relativity, plate tectonics, self-replication, or cell division unfold from the earliest ideas of their earliest proponents (and opponents) onwards up to you, your colleagues, and those with whom you compete for grants. So why don't we do it?
\begin{abstract}
There is much debate on how public participation and expertise can be brought together in collaborative knowledge environments. One of the experiments addressing the issue directly is Citizendium. In seeking to harvest the strengths (and avoiding the major pitfalls) of both user-generated wiki projects and traditional expert-approved reference works, it is a wiki to which anybody can contribute using their real names, while those with specific expertise are given a special role in assessing the quality of content. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates. We provide an overview of how Citizendium is structured and what it offers to the open knowledge communities, particularly to those engaged in education and research. Special attention will be paid to the structures and processes put in place to provide for transparent governance, to encourage collaboration, to resolve disputes in a civil manner and by taking into account expert opinions, and to facilitate navigation of the site and contextualization of its contents.
\keywords{open knowledge, open education, open science, open \\governance, wikis, expertise, Citizendium, Semantic Web}
\end{abstract}


Traditionally, given the scope of a  particular journal, knowledge about specialist terms (which may describe  completely non-congruent concepts in different fields), methodologies,  notations, mainstream opinions, trends, or major controversies could  reasonably be expected to be widespread amongst the audience, which  reduced the need to redundantly say and then repeat the same things all  over again and again (in cross-disciplinary environments, there is a  higher demand for proper disambiguation of the various meanings of a  term). Nonetheless, redundancy is still quite visible in journal  articles, especially in the introduction, methods, and discussion  sections and the abstracts, often in a way characteristic of the authors  (such that services like eTBLAST and JANE can make qualified guesses on  authors of a particular piece of text, with good results if some of the  authors have a lot of papers in the respective database, mainly PubMed,  and if they have not changed their individual research scope too often  in between).


A manuscript well-adapted to the scope  of one particular journal is often not very intelligible to someone  outside its intended audience, which hampers cross-fertilization with  other research fields (we will get back to this below). When using paper  as the sole medium of communication there is not much to be done about  this limitation. Indeed, we have become so used to it that some do not  perceive it as a limitation at all. Similar thoughts apply to manuscript  formatting. However, the times when paper alone reigned over scholarly  communication have certainly passed, and wiki-like platforms provide for  simple and efficient means of storing information, updating it and  embedding it into a wider context.
\section{Introduction}


Cross-field fertilization is crucial  with respect to interdisciplinary research projects, digital libraries  and multi-journal (or indeed cross-disciplinary) bibliographic search  engines (e.g. Google Scholar), since these dramatically increase the likelihood of, say, a biologist stumbling upon a not primarily  biological source relevant to her research (think shape quantification  or growth curves, for instance). What options do we have to systematically integrate such cross-disciplinary hidden treasures with  the traditional intra-disciplinary background knowledge and with new  insights resulting from research?
\begin{quote}
{\it Science is already a wiki if you look at it a certain way. It's just a highly inefficient one -- the incremental edits are made in papers instead of wikispace, and significant effort is expended to recapitulate existing knowledge in a paper in order to support the one to three new assertions made in any one paper. } \begin{flushright} John Wilbanks \cite{Wilbanks2009}
\end{flushright}\end{quote}


The by now classical example of a wiki environment are the Wikipedias, a set of interlinked wikis in multiple languages where basically anyone can edit any page, regardless of subject matter expertise or command of the respective language. As a consequence of this openness, the larger Wikipedias have a serious problem with vandalism: take an article of your choice and look in its history page for reverts - most of them will be about neutralizing subtle or blunt forms of destructive edits that do nothing to improve the quality of the articles, but may reduce it considerably. Few of these malicious edits persist for long, but finding and fixing them takes time that could better be spent on improving articles. This is less of an issue with more popular topics for which large numbers of volunteers may be available to correct "spammy" entries but it is probably fair to assume that most researchers value their time too much to spend it on repeatedly correcting information that had already been correctly entered once. Other problems with covering scientific topics at the Wikipedias include the nebulous notability criteria which have to be fulfilled to avoid an article being deleted, and the rejection of "original research" in the sense of not having been peer reviewed before publication. Despite these problems, one  scientific journal —  RNA biology — already requires an introductory  Wikipedia article for a subset of papers it is to publish.  
There are many ways to structure knowledge, including collaborative arrangements of digital documents. Only a limited number of the latter ones have so far been employed on a larger scale. Amongst them are wikis~-- online platforms which allow the aggregation, interlinking and updation of diverse sets of knowledge in an Open Access manner, i.e. with no costs to the reader.  


Peer review is indeed a central aspect of scholarly communication, as it paves the way towards the reproducibility that forms one of the foundations of modern science. Yet we know of no compelling reason to believe that it works better before than after the content concerned has been made public (doing it beforehand was just a practical decision in times when journal space was measured in paper pages), while emerging movements like Open Notebook Science &mdash; where claims are linked directly to the underlying data that are being made public as they arise &mdash; represent an experiment in this direction whose initial results look promising and call into question the "no original research" as a valid principle to generate encyclopedic content.
\subsection{Wikis as an example of public knowledge environments online}


Although quite prominent at the moment, the Wikipedias are not the only wikis around, and amongst the more scholarly inclined alternatives, there are even a number of wiki-based journals, though usually with a very narrow scope and/or a low number of articles. On the other hand, Scholarpedia (which has classical peer review and an ISSN and may thus be counted as a wiki journal, too), OpenWetWare, Citizendium and the Wikiversities are cross-disciplinary and structured (and of a size, for the moment) such that vandalism and notability are not really a problem. With minor exceptions, real names are required at the first three, and anybody can contribute to entries about anything, particularly in their fields of expertise. None of these is even close to providing the vast amount of context existing in the English Wikipedia but the difference is much less dramatic if the latter were broken down to scholarly useful content. Out of these four wikis, only OpenWetWare is explicitly designed to harbour original research, while the others allow different amounts thereof. Furthermore, a growing number of yet more specialized scholarly wikis exist (e.g. WikiGenes, the Encyclopedia of Earth, the Encyclopedia of Cosmos, the Dispersive PDE Wiki, or the Polymath Wiki), which can teach us about the usefulness of wikis within specific academic fields.
As implied by the introductory quote, it is probably fair to say that turning science (or any system of knowledge production, for that matter) into a wiki (or a set of interlinked collaborative platforms) would make research, teaching and outreach much more transparent, less prone to hype, and more efficient. Just imagine you had a time slider and could watch the history of research on general relativity, plate tectonics, self-replication, or cell division unfold from the earliest ideas of their earliest proponents (and opponents) onwards up to you, your colleagues, and those with whom you compete for grants. So why don't we do it?
 
== The Citizendium model of a wiki-based collaboration ==
 
Despite the above-mentioned tensions between public participation and expertise in the collaborative structuring of knowledge, it is not unreasonable to expect that these can be overcome by suitably designed public knowledge environments, much like Citizen Science projects involve the public in the generation of scientific data. One approach at such a design is represented by Citizendium. The founder of Citizendium &mdash; Larry Sanger &mdash; being the co-founder of Wikipedia, the two projects share the common goal of providing free knowledge to the public, and they are based on variants of the same software platform. Yet they differ in a number of important ways, such that Citizendium can be seen as composed of a Wikipedia core (stripped down in terms of content, templates, categories and policies), with elements added that are characteristic of the other wiki environments
introduced above: A review process leading to stable versions (as at Scholarpedia), an open education environment (as at Wikiversity) and an open research environment (as at OpenWetWare). Nonetheless, assuming that the reader is less familiar with these three latter environments, we will follow previous commenters and frame the following discussion of Citizendium in terms of properties differentiating it from Wikipedia, and the latter's English language branch in particular.
 
=== Real names ===
The first of these is simply an insistence on real names, as is custom in professional environments. This is unusual for a wiki and will exclude a number of legitimate contributors who prefer to remain anonymous, but otherwise give participants accountability and allow to bring in external reputation to the project.
 
=== Expert guidance ===
To compose and develop articles and to embed them in the multimedial context of a digital knowledge environment, expert guidance is important. Of course, many experts contribute to Wikipedia, and the Wikipedias in turn have long started to actively seek out expert involvement, yet the possibility to see their edits overturned by anonymous users that may lack even the most basic education in that field keeps professionals away from spending their precious time on such a project. The Citizendium approach of verifying expertise takes a different approach &mdash; sometimes termed "credentialism" &mdash; that rests on a common sense belief that some people do know more than others: it is sometimes the case that the thirteen-year-old kid in Nebraska does know more than the physics professor. But most of the time, at least when matters of physics are concerned, this is not the case. The role the experts have at Citizendium is not, as frequently stated in external comments, that of a supreme leader who is allowed to exercise his will on the populace. On the contrary, it is much more about guiding. We use the analogy of a village elder wandering around the busy marketplace who can resolve disputes and whom people respect for their mature judgement, expertise and sage advice. Wikipedia rejects "credentialism" in much the same way that the Internet Engineering Task Force (IETF) does. David Clark summarised the IETF process thusly: "We reject kings, presidents and voting. We believe in rough consensus and running code." In an open source project, or an IETF standardisation project, one can decide a great many of the disputes with reference to the compiler. If the code doesn't compile, think again. For rough consensus to happen under such circumstances, one needs to get the people together who have some clear aim in mind: getting two different servers to communicate with one another. The rough consensus required for producing an encyclopaedia article is different &mdash; it should attempt to put forward what is known, and people disagree on this to a higher degree than computers do on whether a proper connection has been established. It is difficult to get "rough consensus, running code" when two parties are working on completely different epistemological standards. At this point, one needs the advice of the village elderly who will vet existing content and provide feedback on how it can be expanded or otherwise improved. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these vetted entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates.
 
Critics of Citizendium seem to think that the respect for experts is solely because of their knowledge of facts &mdash; as if whether or not the articles are good is dependent on whether or not the facts are good. This is only part of the reasoning: the experts point out and correct factual mistakes, but they also help to guide the structuring of the subpages. The experts bring with them the experience and knowledge of years of in-depth involvement with their subject matter, and the project is designed to make best use of this precious resource, while still allowing everyone to participate in the process. Of course, experts are likewise free to bring in content, be it within their specialty or in other areas, where others take over the guiding role. The Citizendium can also host 'Signed Articles', which are placed in a subpage alongside the main article. A Signed Article is an article on the topic described by a recognised expert in the field, but can express opinions and biases in a way that the main article ought not to.
 
 
=== Contextualization ===
Fourth, Citizendium attempts to ''structure'' knowledge in a different way. Each article on Citizendium can make comprehensive use of Subpages, i.e. pages providing additional information that are subordinate to an article's page. Some of these &mdash; e.g. Bibliography, External Links, Video, Code, Catalog, Timeline, Advanced Level, Tutorial or general-purpose Addendum subpages &mdash; are similar to but more flexible than the supplementary online materials now being published routinely along scholarly articles. Two subpages types are different, with ''keywords'' and ''running title'' being the closest analogs from academic papers: All pages are encouraged to have a short Definition subpage (around 30 words or 150 characters) which defines or describes the subject of the page. They are also encouraged to have a comprehensive Related Articles subpage, which uses templates to pull in the definitions from the pages that it links to. If one looks at the Related Articles subpage of 'Biology', one can see the parent topics of biology (science), the subtopics - subdisciplines of biology like zoology, genetics and biochemistry, articles on the history of biology and techniques used by biologists - and finally other related topics, including material on the life cycle, the various biochemical substances like DNA and proteins, the components of the cell, and other specialised language. This Related Articles page gives a pretty comprehensive contextual introduction to what biology is all about, and is structured by the authors of the article in a way that is consistent across the site. This goes beyond Wikipedias categories, ''See also'' sections and ad-hoc infoboxes and can be considered as a next step towards linking encyclopaedic content with the Semantic Web.
 
Subpages are one way in which Citizendium is attempting to go beyond what is provided in either traditional paper-based encyclopaedias or by Wikipedia: to engage with context, with related forms of knowledge, and to emancipate knowledge from the page format to which it was confined in the print era. Marx wrote that "Philosophers have hitherto only interpreted the world in various ways; the point is to change it". Traditional encyclopaedias attempt to reflect the world, but we are attempting to go further. The open science movement - which has formed around the combination of providing open access to journal articles, making scientific data more openly available in raw forms, using and sharing open source software and experimenting with some of the new techniques appearing from the community that is formed under the 'Web 2.0' banner - is exploring the edge of what is now possible for scientists to do to create new knowledge. Some of the electronic engagements by academics has been for actual research benefit, some has just been PR for universities - doing podcasts to sound 'relevant'. The Citizendium model, while a little bit more traditional than some of the open science platforms, is willing to try a variety of new things. Wikipedia has produced a pretty good first version of a collaboratively written encyclopedia &mdash; the challenge is to see if we can go further and produce a citizens' compendium of structured and comprehensive knowledge and update it as new evidence or insights arise.
 
== Open governance ==
 
Citizendium has an evolving, but hopefully soon-to-be clearly defined governance process - currently, a Charter is being drafted by an elected group of writers that will allow for democratic governance and oversight. The broad outline is this: we will have a democratically elected Editorial Council which will deal with content policy and resolving disputes regarding content, and we will also have a Management Committee, responsible for anything not related to content. The Management Committee appoint Constables who uphold community policy regarding behaviour. Disputes with the Constables can be brought to an Ombudsman selected by the Editorial Council and Management Committee. The charter is still to be ratified by the community. One of the reasons we have this is that although there is a cost to having bureaucracy and democracy, the benefits of having an open governance process outweigh the costs. We have a real problem when governments of real-life communities are controlled by shadowy cabals who invoke byzantine legal codes - all the same problems would seem to apply to online communities. With a Wikipedia article, the debate seems to rarely be the content itself, but all too often ritualized arguments about acronyms (AfDs, NPOV, CSD, ArbCom, OR etc.). There is always a challenge in any knowledge-based community in attempting to reconcile a fair and democratic process with a meritocratic respect for expertise. There are no easy answers - if we go too far towards bureaucracy, we risk creating a system where management is separated from the actual day-to-day writing of the site, while if we attempt to let the site 'manage itself', we risk creating a rather conservative mob rule that doesn't afford due process to interested outsiders. A more traditional management structure, combined with real names and civility, should help those outside of the online community - the many experts in real life who work in universities, in business and in public life - be able to participate. Hopefully, if we get the governance decisions right, we can also not get in the way of the people who engage on hobbyist terms with Citizendium.
 
==Open education==
An important part of the governance process is collaboration with those outside of Citizendium. We have a long-standing project called Eduzendium, which allows for educators in higher education to work on articles as part of a course. We have most recently had politics students from the Illinois State University work on articles on pressure groups in American public life, as well as medical students from Edinburgh, biologists from City University of New York and the University of Colorado at Boulder, finance students from Temple University and others. These courses reserve a batch of articles usually for one semester, assign each article to one or more students. The course leader can either reserve the articles for just the group to work on, or they can work on them alongside editors on the site.
 
There are still a number of challenges and opportunities:
*CZ -- in many fields -- does not yet meet its own standard to offer reliable expert content, while the desired atmosphere of cooperation works well
 
==Open questions==
* how to motivate registered users to contribute
* how to motivate more users to register
* how to allow feedback by non-registered users
* how to codify the policies (and especially the subpages system) into a MediaWiki extension
* financial perspectives
 
==Open perspectives==
* contextualization
* potential for mutually beneficial partnerships with projects at similar wavelengths, e.g. [http://acawiki.org/ AcaWiki] for references, [http://openwetware.org/ OpenWetWare] for primary research, Open Access publishers as possible content providers
 
 
Just imagine you had a time slider and could watch the history of knowledge on tool making, cooking, clothing, learning, general relativity, plate tectonics, self-replication, or cell division unfold from the earliest ideas of their earliest proponents (and opponents) onwards up to now.
 
==Figures==
''We should probably add a few illustrations of some core aspects (e.g. screenshots of Related Articles, Approval, Charter, Eduzendium, plus possibly some of the diagrams from RationalWiki). Please put them here.''


==References==
Traditionally, given the scope of a particular journal, knowledge about specialist terms (which may describe completely non-congruent concepts in different fields), methodologies, notations, mainstream opinions, trends, or major controversies could reasonably be expected to be widespread amongst the audience, which reduced the need to redundantly say and then repeat the same things all over again and again (in cross-disciplinary environments, there is a higher demand for proper disambiguation of the various meanings of a term). Nonetheless, redundancy is still quite visible in journal articles, especially in the introduction, methods, and discussion sections and the abstracts, often in a way characteristic of the authors (such that services like eTBLAST and JANE can make qualified guesses on authors of a particular piece of text, with good results if some of the authors have a lot of papers in the respective database, mainly PubMed, and if they have not changed their individual research scope too often in between).
''Just links will do fine for the time being - Wiki and LaTeX are not compatible in this regard.''


*[http://jcom.sissa.it/archive/09/01/Jcom0901%282010%29C01/Jcom0901%282010%29C04 Shirky and Sanger, or the costs of crowdsourcing]
A manuscript well-adapted to the scope of one particular journal is often not very intelligible to someone outside its intended audience, which hampers cross-fertilization with other research fields (we will get back to this below). When using paper as the sole medium of communication there is not much to be done about this limitation. Indeed, we have become so used to it that some do not perceive it as a limitation at all. Similar thoughts apply to manuscript formatting. However, the times when paper alone reigned over scholarly communication have certainly passed, and wiki-like platforms provide for simple and efficient means of storing information, updating it and embedding it into a wider context.
:Contains a number of critical remarks on CZ that may be worth addressing.
:Summary in the [http://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2010-03-22/In_the_news#Role_of_experts_on_Wikipedia_and_Citizendium_examined Wikipedia signpost]
* [http://rationalwiki.com/wiki/Citizendium RationalWiki article on Citizendium]


==Acknowledgements==
Cross-field fertilization, for example, is crucial with respect to interdisciplinary research projects, digital libraries and multi-journal (or indeed cross-disciplinary) bibliographic search engines (e.g. Google Scholar), since these dramatically increase the likelihood of, say, a biologist stumbling upon a not primarily biological source relevant to her research (think shape quantification or growth curves, for instance). What options do we have to systematically integrate such cross-disciplinary hidden treasures with the traditional intra-disciplinary background knowledge and with new insights resulting from research?
The authors wish to thank Russell D. Jones, Howard C. Berkowitz, Steven Mansour and Peter Schmitt for critical comments on earlier versions of this draft and Charles van den Heuvel for helpful comments in a related discussion.


==Further notes==
The by now classical example of a wiki environment are the Wikipedias, a set of interlinked wikis in multiple languages where basically anyone can edit any page, regardless of subject matter expertise or command of the respective language. As a consequence of this openness, the larger Wikipedias have a serious problem with vandalism: take an article of your choice and look at its history page for reverts - most of them will be about neutralizing subtle or blunt forms of destructive edits that do nothing to improve the quality of the articles, but may reduce it considerably. Few of these malicious edits persist for long  \cite{Priedhorsky:2007}, but finding and fixing them takes time that could better be spent on improving articles. This is less of an issue with more popular topics for which large numbers of volunteers may be available to correct "spammy" entries but it is probably fair to assume that most researchers value their time too much to spend it on repeatedly correcting information that had already been correctly entered. Other problems with covering scientific topics at the Wikipedias include the nebulous notability criteria which have to be fulfilled to avoid an article being deleted, and the rejection of "original research" in the sense of not having been peer reviewed before publication. Despite these problems, one scientific journal~-- RNA Biology~-- already requires an introductory Wikipedia article for a subset of papers it is to publish \cite{RNABiol}.


*Speaker bio:
Peer review is indeed a central aspect of scholarly communication, as it paves the way towards the reproducibility that forms one of the foundations of modern science. Yet we know of no compelling reason to believe that it works better before than after the content concerned has been made public (doing it beforehand was just a practical decision in times when journal space was measured in paper pages), while emerging movements like Open Notebook Science~-- where claims are linked directly to the underlying data that are being made public as they arise~-- represent an experiment in this direction whose initial results look promising and call into question Wikipedia's "no original research" as a valid principle for generating encyclopaedic content.


Tom Morris is a postgraduate philosophy student and programmer and has been actively involved as an author in the Citizendium project since October 2007.
Although quite prominent at the moment, the Wikipedias are not the only wikis around, and amongst the more scholarly inclined alternatives, there are even a number of wiki-based journals, though usually with a very narrow scope and/or a low number of articles. On the other hand, Scholarpedia (which has classical peer review and an ISSN and may thus be counted as a wiki journal, too \cite{Scholarpedia}), OpenWetWare \cite{OpenWetWare}, Citizendium \cite{Citizendium} and the Wikiversities \cite{Wikiversity} are cross-disciplinary and structured (and of a size, for the moment) such that vandalism and notability are not really a problem. With minor exceptions, real names are required at the first three, and anybody can contribute to entries about anything, particularly in their fields of expertise. None of these is even close to providing the vast amount of context existing in the English Wikipedia but the difference is much less dramatic if the latter were broken down to scholarly useful content. Out of these four wikis, only OpenWetWare is explicitly designed to harbour original research, while the others allow different amounts thereof. Furthermore, a growing number of yet more specialized scholarly wikis exist (e.g. WikiGenes \cite{WikiGenes}, the Encyclopedia of Earth \cite{EoEarth}, the Encyclopedia of Cosmos \cite{EoCosmos}, the Dispersive PDE Wiki \cite{Dispersive-PDE}, or the Polymath Wiki \cite{Polymath}), which can teach us about the usefulness of wikis within specific academic fields.  


\section{The Citizendium model of wiki-based collaboration}
Despite the above-mentioned tensions between public participation and expertise in the collaborative structuring of knowledge, it is not unreasonable to expect that these can be overcome by suitably designed public knowledge environments, much like Citizen Science projects involve the public in the generation of scientific data. One approach at such a design is represented by Citizendium. The founder of Citizendium~-- Larry Sanger~-- is the co-founder of Wikipedia. The two projects share the common goal of providing free knowledge to the public, they are based on variants of the same software platform, and they use the same Creative Commons-Attribution-Share Alike license \cite{CC-BY-SA}. Yet they differ in a number of important ways, such that Citizendium can be seen as composed of a Wikipedia core (stripped down in terms of content, templates, categories and policies), with elements added that are characteristic of the other wiki environments introduced above: A review process leading to stable versions (as at Scholarpedia), an open education environment (as at Wikiversity) and an open research environment (as at OpenWetWare). Nonetheless, assuming that the reader is less familiar with these three latter environments, we will follow previous commenters and frame the discussion of Citizendium in terms of properties differentiating it from Wikipedia, and specifically the latter's English language branch \cite{Wikipedia:En}.


*Just some suggestions for consideration from Aleta, not intended to be cast in stone.  Question:  what do you mean by an 'organically-growing wiki' (fifth line in abstract)?  Doesn't resonate with me, can you say it in a different way?
\subsection{Real names}
The first of these is simply an insistence on real names. While unusual from a Wikipedia perspective, this is custom in professional environments, including traditional academic publishing and some of the above-mentioned wikis, e.g. Scholarpedia and Encyclopedia of Earth. It certainly excludes a number of legitimate contributors who prefer to remain anonymous but otherwise gives participants accountability and allows to bring in external reputation to the project.


*There is a talk given by Chris Day on Citizendium in mid-2008 at [http://ccbw.calit2.net/video.html this workshop]: [http://www.scivee.tv/node/6673 video]. His slides may serve as the [http://docs.google.com/present/embed?id=ddwhqd6k_296csrfjmvg basis for Tom's] on this occasion (anyone can edit them)
\subsection{Expert guidance}


*In preparation for [[CZ:Biology Week]], we had already drafted a [[CZ:Biology Week/Primer|primer]] and turned it into [http://ways.org/en/blogs/2008/aug/06/reference_knowledge_structured_by_experts_and_the_public a blog post] that may serve as a seed for this draft.
\begin{figure}
\centering
\includegraphics[width=12.2cm]{Approved}
\caption{Screenshot of the main page of the [[Crystal Palace]] cluster while logged in using a monobook skin that is the default at Wikipedia. It shows the \textit{green cluster bar} that indicates that the page has been approved and links to all the supages. Also visible is the \textit{status indicator} (green dots on the left topped by green tick), mention of \textit{"an editor"} to distinguish the number of editors involved (some pages can be approved by one rather than three editors), links to the workgroups which have approval rights for the article (in this case: the \textit{History and Architecture Workgroups}), a prominent \textit{disclaimer} (unapproved articles have a much strong disclaimer), and links to the 'unstable' \textit{draft} version of the article which any registered contributor can update. Like traditional encyclopaedic environments, Citizendium does not require every statement to be referenced, in the interest of narrative flow.}
\label{fig:Approved}
\end{figure}
To compose and develop articles and to embed them in the multimedial context of a digital knowledge environment, expert guidance is important. Of course, many experts contribute to Wikipedia, and the Wikipedias in turn have long started to actively seek out expert involvement, yet the possibility to see their edits overturned by anonymous users that may lack even the most basic education in that field keeps professionals away from spending their precious time on such a project. The Citizendium approach of verifying expertise takes a different approach~-- sometimes termed "credentialism"~-- that rests on a common sense belief that some people do know more than others: it is sometimes the case that the thirteen-year-old kid in Nebraska does know more than the physics professor. But most of the time, at least when matters of physics are concerned, this is not the case. The role the experts have at Citizendium is not, as frequently stated in external comments, that of a supreme leader who is allowed to exercise his will on the populace. On the contrary, it is much more about guiding. We use the analogy of a village elder wandering around the busy marketplace \cite{Basar} who can resolve disputes and whom people respect for their mature judgement, expertise and sage advice. Wikipedia rejects "credentialism" in much the same way that the Internet Engineering Task Force (IETF) does. David Clark summarised the IETF process thusly \cite{Clark:1992}: "We reject kings, presidents and voting. We believe in rough consensus and running code." In an open source project, or an IETF standardisation project, one can decide a great many of the disputes with reference to technical reality: the compiler, the existing network protocols etc. If the code doesn't compile, think again. For rough consensus to happen under such circumstances, one needs to get the people together who have some clear aim in mind: getting two different servers to communicate with one another. The rough consensus required for producing an encyclopaedia article is different~-- it should attempt to put forward what is known, and people disagree on this to a higher degree than computers do on whether a proper connection has been established. It is difficult to get "rough consensus, running code" when two parties are working on completely different epistemological standards. At this point, one needs the advice of the village elderly who will vet existing content and provide feedback on how it can be expanded or otherwise improved. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these vetted entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates (cf.\ Fig.\ \ref{fig:Approved}).


The respect for experts because of their knowledge of facts is only part of the reasoning: the experts point out and correct factual mistakes, but they also help to guide the structuring of content within an article and by means of the subpages. The experts bring with them the experience and knowledge of years of in-depth involvement with their subject matter, and the project is designed to make best use of this precious resource, while still allowing everyone to participate in the process. Of course, experts are likewise free to bring in content, be it within their specialty or in other areas, where others take over the guiding role. The Citizendium can also host 'Signed Articles', which are placed in a subpage alongside the main article. A Signed Article is an article on the topic described by a recognised expert in the field, but can express opinions and biases in a way that the main article ought not to.


===Open knowledge===
* a collaborative platform for creating, sharing, curating and navigating open knowledge
* "The results described here also have implications for the
design of collaborative knowledge systems.  One
recommendation is that during the early phase of the system
resources should initially be allocated towards building
tools for power users and improving expert features, as this
is the population driving early growth.  However, as the
population increases resources should be shifted towards
improving ease of use and effectiveness for novice users, as
well as developing structures and procedures that can
support a large influx of users.  It also suggests that
designers should continue to reevaluate the user population
in anticipation of the shifts seen here." ([http://www.viktoria.se/altchi/submissions/submission_edchi_1.pdf Source])
* "42% of damage is repaired almost
immediately, i.e., before it can confuse, offend, or mislead
anyone. Nonetheless, there are still hundreds of millions of
damaged views." ([http://portal.acm.org/citation.cfm?doid=1316624.1316663 Source])


===Open education===
\begin{figure}
• an Open educational tool and resource
\centering
\includegraphics[width=11.2cm]{Related-Approved}
\includegraphics[width=11.2cm]{Lemma}
\caption{{\bf Top:} Screenshot of the Related Articles subpage from the [[Biology]] cluster (which is approved) while logged in. It shows the \textit{Parent topics} and the first section of the \textit{Subtopics}~-- \textit{subdisciplines}. For each related article, there is a short definition or description of the topic, and a link to its Related Articles subpage (hidden behind the \textit{[r]}), as well as instructions on mouseover and a Table of \textit{Content}. {\bf Bottom:} Related Articles subpage from the [[Open Knowledge Conference]] cluster (while logged out) which has not yet been converted to subpage style but can already be used for structuring information related to the topic. In principle, on could also think of adding [[Open Knowledge Conference 2010]] as a subtopic and using this article for conference blogging. However, the current MediaWiki software cannot handle parallel editing by multiple users, though tools like Etherpad \cite{Etherpad} have shown that it is feasible.}
\label{fig:Related-Approved}
\end{figure}


\subsection{Contextualization}
Citizendium attempts to structure knowledge in a different way. Each article on Citizendium can make comprehensive use of Subpages, i.e. pages providing additional information that are subordinate to an article's page. Some of these~-- e.g. the Sculptures subpage in Fig.\ \ref{fig:Approved}~-- are similar to but more flexible than the supplementary online materials now being published routinely along scholarly articles. Two subpages types are different, with keywords  and running title being the closest analogues from academic papers: All pages are encouraged to have a short Definition subpage (around 30 words or 150 characters) which defines or describes the subject of the page. They are also encouraged to have a comprehensive Related Articles subpage, which uses templates to pull in the definitions from the pages that it links to (a feature that relies on the absence of vandalism). If one looks at the Related Articles subpage of [[Biology]] (cf.\ Fig.\ \ref{fig:Related-Approved}, top), one can see the parent topics of biology (science), the subtopics - subdisciplines of biology like zoology, genetics and biochemistry, articles on the history of biology and techniques used by biologists - and finally other related topics, including material on the life cycle, the various biochemical substances like DNA and proteins, the components of the cell, and other specialised language. This Related Articles page gives a pretty comprehensive contextual introduction to what biology is all about, and is structured by the authors of the article in a way that is consistent across the site (cf.\ Fig.\ \ref{fig:Related-Approved}, bottom). This goes beyond Wikipedias categories, "See also" sections and ad-hoc infoboxes. Citizendium's approach can be considered as an exploratory next step towards linking encyclopaedic content with the Semantic Web.


Taking these educational considerations into practice, Citizendium, in collaboration with teachers and lecturers, has launched Eduzendium [18], a project that allows students to write their course assignments online on the Citizendium. Students work for course credits, and their teachers grade the finished work based on the quality of the article drafts produced from each student's input. But by writing their assignments under this scheme, students not only get to earn grade credits, they can see their work online and add to the global store of knowledge. By collaborating with the rapidly growing Citizendium community of expert and non-expert authors, they stand good chances that their essays eventually develop into a lasting encyclopedic article. Finally, perhaps best of all, students get to learn in a highly collaborative real-time way, and rumours have it that they might actually have fun doing so. Not surprisingly, educators who opted for Eduzendium noticed a higher degree of enthusiasm amongst their students. The educational potential of CZ is enhanced by the use of subpages which provide for an easy integration with other free educational materials like videos, e.g. the non-profit, K-12 educational video contest WatchKnow [19] or, at undergraduate level, the non-profit world lecture project (wlp)° [20].
Subpages (a further usage example is in (cf.\ Fig.\ \ref{fig:Spellings}) are one way in which Citizendium is attempting to go beyond what is provided in either traditional paper-based encyclopaedias or by Wikipedia: to engage with context, with related forms of knowledge, and to emancipate knowledge from the page format to which it was confined in the print era. Marx wrote that "Philosophers have hitherto only interpreted the world in various ways; the point is to change it" \cite{Marx}. Traditional encyclopaedias attempt to reflect the world, but we are attempting to go further. The open science movement - which has formed around the combination of providing open access to journal articles, making scientific data more openly available in raw forms, using and sharing open source software and experimenting with some of the new techniques appearing from the community that is formed under the 'Web 2.0' banner - is exploring the edge of what is now possible for scientists to do to create new knowledge. Some of the electronic engagements by academics has been for actual research benefit, some has just been PR for universities - doing podcasts to sound 'relevant'. The Citizendium model, while a little bit more traditional than some of the open science platforms, is willing to try a variety of new things. Wikipedia has produced a pretty good first version of a collaboratively written encyclopedia~-- the challenge is to see if we can go further and produce a citizens' compendium of structured and comprehensive knowledge and update it as new evidence or insights arise.  


===Open science===
\begin{figure}
#an open knowledge model supporting professional workflows
\centering
#For scholarly uses, a detailed outline can be found in [http://ways.org/en/blogs/2009/sep/29/what_would_science_look_like_if_it_were_invented_today_part_ii_knowledge_structuring this blog post].
\includegraphics[width=12.2cm]{Spellings-Main}
#Demo at [[Research:In Vivo Assessment of Cold Adaptation in Insect Larvae by Magnetic Resonance Imaging and Magnetic Resonance Spectroscopy]]
\includegraphics[width=12.2cm]{Spellings-Catalog}
\caption{{\bf Top:} Screenshot of the main page of the [[English spellings]] cluster while logged out. It shows the \textit{blue cluster bar} that indicates that the page has not been approved and links to  all the supages. Also visible is the \textit{status indicator} (red dots on the left topped by grey dots, indicating the status of a 'developing' article), and a stronger \textit{disclaimer} than on approved pages. Below this standard header, a set of templates links to 'Catalog' subpages that collect links, for each letter of the English alphabet, to \textit{Alphabetical} and \textit{Retroalphabetical} lists of spellings, to lists of \textit{Common misspellings} as well as to an article on the specific \textit{Letter}. {\bf Bottom:} Close-up of the Catalogs subpage hosting the retroalphabetical list of English spellings for the letter T, again cross-linked with all the other subpages in that cluster.}
\label{fig:Spellings}
\end{figure}


CZ covers many fields, both academic and beyond, which are organized in workgroups whose main responsibility is to identifiy a set of core articles around which the field’s knowledge is structured, and to oversee the approval process (editorship in the sense discussed above is defined in terms of these workgroups).
\subsection{Open governance}
Citizendium has an evolving, but hopefully soon-to-be clearly defined governance process - a Charter is in the process of being drafted by an elected group of writers that will allow for democratic governance and oversight. The broad outline is this: we will have a democratically elected Editorial Council which will deal with content policy and resolving disputes regarding content, and we will also have a Management Committee, responsible for anything not related to content. The Management Committee appoint Constables who uphold community policy regarding behaviour. Disputes with the Constables can be brought to an Ombudsman selected by the Editorial Council and Management Committee. At the time of writing, the charter is still to be ratified by the community. One of the reasons we have this is that although there is a cost to having bureaucracy and democracy, the benefits of having an open governance process outweigh the costs. We have a real problem when governments of real-life communities are controlled by shadowy cabals who invoke byzantine legal codes - all the same problems would seem to apply to online communities. With a Wikipedia article, the debate seems to shift very quickly from the truth value or relevance of the content itself into often ritualized arguments about acronyms (AfDs, NPOV, CSD, ArbCom, OR etc.). There is always a challenge in any knowledge-based community in attempting to reconcile a fair and democratic process with a meritocratic respect for expertise. There are no easy answers - if we go too far towards bureaucracy, we risk creating a system where management is separated from the actual day-to-day writing of the site, while if we attempt to let the site 'manage itself', we risk creating a rather conservative mob rule that doesn't afford due process to interested outsiders. A more traditional management structure, combined with real names and civility, should help those outside of the online community - the many experts in real life who work in universities, in business and in public life - to participate on an equal footing. Hopefully, if we get the governance decisions right, we can also not get in the way of the people who engage on hobbyist terms with Citizendium.  


As in traditional encyclopedias and Wikipedia, original research will not be allowed in the main namespace of CZ. Discussions are afloat for including original research into the subpages (e.g. as „signed articles“, similar to contributions to Scholarpedia) or other namespaces. Ways to take academic credit for contributions to CZ are also being discussed [21], whereas bot assistance for fact picking (as in [7]) can be made available on a case-by-case basis to facilitate data-intensive contributions.
\subsection{Open education}
An important part of the governance process is collaboration with partners external to the Citizendium. One of our initiatives~-- called Eduzendium~-- provides for educators in higher education to assign work on wiki articles as part of a course. We have most recently had politics students from the Illinois State University work on articles on pressure groups in American public life, as well as medical students from Edinburgh, biologists from City University of New York and the University of Colorado at Boulder, finance students from Temple University and others. These courses reserve a batch of articles for the duration of the course, and assign each article to one or more students. The course instructor can reserve the articles for just the group of students enrolled in the course, or invite the wider Citizendium community to participate. Much of the formatting is achieved via course-specific templates that can be generated semi-automatically by the instructor and applied throughout the course pages, so that course participants can concentrate on content.
   
\section{Open questions}
The project is still young, resulting in a number of challenges and opportunities. In many fields, Citizendium does not meet our own standards~-- we do not have a full range of expert editors. Larry Sanger once envisioned that Citizendium could reach 100,000 articles by 2012. This would, on average, require about 150 new articles a day to reach; the current level is around 15. It is not obvious how the necessary shift from linear to exponential growth can be achieved.


Cross-disciplinary links are achieved in a variety of ways: First, several workgroups can collaborate on individual articles. Second, each article features a „related articles“ subpage where parent topics, subtopics and related topics are linked independent of their respective workgroups. Third, a coherent disambiguation strategy avoids page name disputes for articles on topics associated with different meanings in different fields, while allowing for a synopsis of what the different uses may have in common. Fourth, Citizendium organizes monthly Write-a-thons on broad topics to which anybody can contribute. Fifth, every user can nominate drafts as „Article of the Week“ or „New Draft of the Week“, and the winning entries are featured on the Welcome page, from where they usually receive lots of edits from specialists and non-specialists alike. Finally, as is typical for wikis, all contributions are immediately visible by anyone, and so the potential of frequent visits to the „recent changes“ page to initiate cross-disciplinary interactions should not be underestimated.
Motivating both editors and authors to take part in both writing and approving of content remains a difficult challenge~-- most experts have very little time to offer for projects that do not contribute to the metrics according to which their performance is evaluated, and others shy away from contributing under their real name and in the presence of experts. Another problem is that the initial structure of the community, and the nature of its interaction with Wikipedia, has led to a few articles on popular pseudoscientific topics which are hard to handle from an editorial perspective because those willing to invest their time on the topics are usually heavily biased in their approach, and most of those capable of evidence-based comment prefer not to contribute to these topics.


Activities in the biomedical fields have been especially visible: Biology is second to history in terms of number of articles (followed by health sciences), second to computers in terms of number of authors (followed by history) and fourth (after computers, engineering and health sciences) in number of editors (for details, see the CZ statistics [22].
The project also needs to allow for more feedback by non-registered readers, without harming the currently very collegial atmosphere that is to a large extent due to the real-name policy and the respect for expertise. We may need to explore how to codify our core policies and collaboration model as a possible MediaWiki extension, from which other wikis could possibly benefit~-- online, "code is law" \cite{Lessig}, as is currently being highlighted by sites like Stack Overflow which have changed the social interactions of participants by changing formal features of user experience and social structure.  We need to find financial backing and support. So far, the project has been run on a basically volunteer-only basis, yet the envisioned growth and improvement of English-language content and the possible start of branches in other languages require a higher degree of professionalisation, for which the upcoming Charter is meant as a basis.
   
\section{Open perspectives}


===Open governance===
Citizendium is open for partnerships with other open science and online knowledge communities and projects. Possible candidate projects would include, for instance, AcaWiki \cite{AcaWiki} for references, OpenWetWare for primary research, and Open Access journals \cite{DOAJ} as possible content providers, and of course the Wikipedias and other public wikis for exchange on matters of content management, community development and user experience. The key strength we think the Citizendium model brings is a greater focus on knowledge contextualization: it will be interesting to see whether we can evolve the social model for knowledge production to keep up with changes in the technological possibilities. Many in the Citizendium community are looking forward to working alongside both academics and those working in the Semantic Web community to tie Citizendium into data projects. We feel that despite the commoditization of Web 2.0 technologies, there is still plenty of opportunities for reinventing and experimenting with new ways to render and collaborate on knowledge production and to see if we can build a more stable, sustainable and collegial atmosphere~-- with democratic and meritocratic elements~-- for experts and the public to work together.
• a democratic and meritocratic community


===General===
\subsubsection*{Acknowledgments.} The authors wish to thank Russell D. Jones, Howard C. Berkowitz, Steven Mansour and Peter Schmitt for critical comments on earlier versions of this draft as well as Claudia Koltzenburg, Fran\c{c}ois Dongier and Charles van den Heuvel for helpful discussions.


An investigation (video lecture by Bill Wedemeyer here, a brief annotation here) of the quality of a set of science articles in the English Wikipedia is currently being written up for classical paper-style publication but the preliminary results indicate that "[t]here is a subset of reliably helpful science articles on the English Wikipedia for outreach, teacher training, and general science education" (slide shown at 29:35min in the video). However, the distribution of the set of articles was skewed towards the Good Article and Featured Article classes, which constituted only 2% of the English Wikipedia at the time of investigation, and it did not include articles in the humanities (scheduled to come next). Further information on academic studies about Wikipedia is available via these two Wikipedia pages.
\begin{thebibliography}{4}


\bibitem{AcaWiki} AcaWiki,\\ \url{http://acawiki.org/} \\All URLs referenced in this article were functional as of March 31, 2010.


\bibitem{Citizendium} Citizendium,\\ \url{http://www.citizendium.org/}


\bibitem{Clark:1992} Clark, D.: Plenary lecture, "A Cloudy Crystal Ball~-- Visions of the Future", Proc. 24th IETF: 539 (1992),\\ \url{http://www.ietf.org/proceedings/prior29/IETF24.pdf}


mention
\bibitem{CC-BY-SA} Creative Commons-Attribution-Share Alike license 3.0,\\ \url{http://creativecommons.org/licenses/by-sa/3.0/}
interactiveness


Each article can also have a comprehensive, categorised bibliography with annotations, pointing to books and journal articles on the subject. For scientific and academic topics, we attempt to write the list in a way so as to be useful both to a novice to the subject and to students and experts: much like a good academic reading list (e.g. [http://www.ucl.ac.uk/philosophy/LPSG/ London Philosophy Study Guide]).
\bibitem{DOAJ} Directory of Open Access Journals,\\ \url{http://www.doaj.org/}


\bibitem{Dispersive-PDE} Dispersive PDE Wiki,\\ \url{http://tosio.math.utoronto.ca/wiki/}


the category system used on Wikipedia isn't. Wikipedia has something similar with some of the sub-boxes you find at the end of articles, but we feel that the Related Articles subpage system allows for more detail, and is comprehensive rather than ad-hoc.
\bibitem{EoCosmos}  Encyclopedia of Cosmos,\\ \url{http://www.cosmosportal.org/}
much further in the direction of Semantic Web.


''Better group the subpage types, as per [[#Comments]] by Peter.''
\bibitem{EoEarth} Encyclopedia of Earth,\\ \url{http://www.eoearth.org}
In all this


\bibitem{Etherpad} Etherpad source code,\\ \url{http://code.google.com/p/etherpad/}


facts, but we also hope they bring with them wisdom gathered from extended in-depth knowledge of their subject matter.
\bibitem{Lessig} Lessig, Lawrence: Code and Other Laws of Cyberspace,\\ \url{http://codev2.cc/}


The External Links subpage provides something similar to the Bibliography page but for web resources - pointing to relevant organizations, educational resources and other resources. For articles about authors, we allow for a 'Works' subpage to list the person's written works. For musicians and musical groups, a discography subpage can be added; for actors, producers and directors of film and television, a filmography subpage can be added. For some topics, we allow for a Timelines subpage to be added where a comprehensive timeline or multiple timelines about the topic can be presented (we have one, for instance, on the article on Tony Blair). The Catalogs Subpages exist to contain lists or tables of information much like that found in almanacs. Articles on food and cuisine can have a Recipes subpage.
\bibitem{Marx} Marx, Karl: Theses on Feuerbach,\\ \url{http://www.marxists.org/archive/marx/works/1845/theses/theses.htm}


We have Subpages to contain extra images, as well as audio and video resources, and for programming-related articles, to contain code samples and tutorials (for example, the article on Perl - also, some mathematical articles will contain a machine-readable implementation on the Code Subpage). The Subpages system can also contain alternative presentations of the topic at a variety of different levels - 'Advanced' Subpages can contain a version more suited to experts in the field, while 'Student Level' provides one more suited to children. A 'Debate Guide' Subpage can be created to provide an outline of all the arguments on a disputed topic.
\bibitem{OpenWetWare} OpenWetWare,\\ \url{http://www.openwetware.org/}


== Comments ==
\bibitem{Polymath} Polymath WIki,\\ \url{http://michaelnielsen.org/polymath1/}
:*Initial reactions: 
:#I suppose an inorganically growing wiki would use silicon...and it does. ''Some'' things cast in stone, indeed, would have high silicon content.  It is, perhaps, a metaphor to avoid.
:#Not knowing much about Rationalwiki, yes, the article raises legitimate questions about some areas, such as healing arts. I would hope, however, that the observations on [[herding cats]] display some inability or unwillingness to recognize humor, and, indeed, informal analysis of idioms. It does seem needlessly antagonistic.
:#Real name policy needs, I think, to be in a broader perspective than comparison to Wikipedia. Netnews/USENET, for example, started declining in utility once AOL made public, anonymous access possible (1988 or thereabouts). Previously, while there was no real name policy, to get access, one had to be affiliated with a research or academic group, or have someone there willing to give you an account: a reputation factor.
:#Reputation factors, also called karma systems, have been used in blogs, and, I believe, are quite appropriate for Wikis. I believe the first widespread use was at the Well. There is a tension between name verification and reputation.
:#Contextualization is, I believe, one of the great opportunities, but it's fair to say that it's experimental. Nevertheless, it would be worth showing a decent Related Articles page, and perhaps compare-and-contrast it with Semantic Web techniques. Our subpages have a steep learning curve, but I wonder if any structured knowledge does not.
:[[User:Howard C. Berkowitz|Howard C. Berkowitz]] 22:25, 24 March 2010 (UTC)
::For [[Linked Data]], see [http://ff.im/hUcjp this discussion], for example. --[[User:Daniel Mietchen|Daniel Mietchen]] 23:17, 24 March 2010 (UTC)


:::Since the duties of a Managing Editor are still being discussed, I'd hesitate to publish it.  
\bibitem{Priedhorsky:2007}
Priedhorsky R, Chen J, Lam STK, Panciera K, Terveen L, et~al. (2007) Creating,
  destroying, and restoring value in wikipedia.
In: GROUP '07: Proceedings of the 2007 international ACM conference
  on Supporting group work. New York, NY, USA: ACM, pp. 259--268.
\url{http://doi.acm.org/10.1145/1316624.1316663}.


:::Reified argument? --[[User:Howard C. Berkowitz|Howard C. Berkowitz]] 01:00, 29 March 2010 (UTC)
\bibitem{Basar} Raymond, Eric S.: The Cathedral and the Bazaar, \\ \url{http://www.catb.org/~esr/writings/homesteading/}
\bibitem{RNABiol} RNA Biology, Guidelines for the RNA Families Track,\\ \url{http://www.landesbioscience.com/journals/rnabiology/guidelines/}


::::Are we going to have slides? If so, I'm using a Mac so it'd be useful if they could be in Keynote format. –[[User:Tom Morris|Tom Morris]] 05:36, 29 March 2010 (UTC)
\bibitem{Scholarpedia} Scholarpedia,\\ \url{http://www.scholarpedia.org/}


:::::@Howard, I am aware of the problems related to the draft not being finished, but think the role should be mentioned somehow. Any suggestions on the phrasing?
\bibitem{WikiGenes} WikiGenes,\\ \url{http://www.wikigenes.org/}
:::::@Tom, whether to use slides or not is up to you (I tend to avoid them), but some old slides from a similar presentation by Chris are at [[#Further notes]]. Keynote is not very compatible with the rest of the world, so I suggest drafting them in the Google Doc I set up for the purpose, from where they can be exported in various formats. If we don't go for sophisticated formatting, this should work fine. Still four weeks for figuring it out, though. --[[User:Daniel Mietchen|Daniel Mietchen]] 08:41, 29 March 2010 (UTC)


::::::It was more just so that if we need to show any images. I generally don't do "PowerPoint" - I just use slides to show images. Probably what is easiest is if we need images, just have a list and I'll download them (or screenshot them) and load them into Keynote. –[[User:Tom Morris|Tom Morris]] 11:02, 29 March 2010 (UTC)
\bibitem{Wikipedia:En} English Wikipedia,\\ \url{http://en.wikipedia.org}


:::::::Given that the drafting committee has not made its discussions on the role public even to the CZ community, and there remains substantial discussion, I do not feel that any roles should be published, outside, that have not even reached the Citizen draft comment page. As far as suggestions on the phrasing, that is a matter of discussion in the committee; if I had better wording, I would have offered it there. I am certainly not going to offer it first for this presentation.  
\bibitem{Wikiversity} Wikiversity,\\ \url{http://www.wikiversity.org}


:::::::I would appreciate responses to the specific points I did make here. [[User:Howard C. Berkowitz|Howard C. Berkowitz]] 13:05, 29 March 2010 (UTC)
\bibitem{Wilbanks2009} Wilbanks, J.: Publishing science on the web,\\ \url{http://scienceblogs.com/commonknowledge/2009/07/publishing_science_on_the_web.php}


::::::::I numbered your points from above, so as to facilitate direct responses:
\end{thebibliography}
::::::::#[http://en.citizendium.org/wiki?title=User%3ADaniel_Mietchen%2FSandbox%2FOpen_Knowledge_Conference_2010&diff=100654548&oldid=100654540 rephrased]
::::::::#While I am considering to use some of their diagrams, I do not think there was any thought on bringing in some of their language.
::::::::#Yes &mdash; how to phrase it?
::::::::#Yes &mdash; how to phrase it?
::::::::#Yes &mdash; how to phrase it?
::::::::As for the role, I am waiting for feedback from the committee, and in the absence thereof, it will not be mentioned herein.
::::::::--[[User:Daniel Mietchen|Daniel Mietchen]] 14:07, 29 March 2010 (UTC)


(unindent)<br>
\end{document}
At the moment, I do not have the time to carefully read the text and comment it (or even edit it).
</pre>
But I noticed that subpages are dealt with quite in detail. Perhaps in too much detail.
It may be debated whether there is a need for External Links AND Bibliography (both serve they same purpose),
and if it is necessary to distinguish Works from Discography, Filmography, ..., while all are essentialy Catalogs.
I would just say that there are subpages for all this material.
<br> Is there included some warning that CZ -- in many fields -- does not yet meet its own standard to offer reliable expert content,
while the desired atmosphere of cooperation works well? --[[User:Peter Schmitt|Peter Schmitt]] 00:19, 30 March 2010 (UTC)
:Yes to all &mdash; thanks! --[[User:Daniel Mietchen|Daniel Mietchen]] 00:32, 30 March 2010 (UTC)

Latest revision as of 04:08, 1 April 2010

This document hosts a contribution to the Open Knowledge Conference 2010. Style as per http://www.springer.com/computer/lncs?SGWID=0-164-6-793341-0. LaTeX source of the submitted version is pasted in below. 


%%%%%%%%%%%%%%%%%%%%%%% file typeinst.tex %%%%%%%%%%%%%%%%%%%%%%%%%
%
% This is the LaTeX source for the instructions to authors using
% the LaTeX document class 'llncs.cls' for contributions to
% the Lecture Notes in Computer Sciences series.
% http://www.springer.com/lncs       Springer Heidelberg 2006/05/04
%
% It may be used as a template for your own input - copy it
% to a new file with a new name and use it as the basis
% for your article.
%
% NB: the document class 'llncs' has its own and detailed documentation, see
% ftp://ftp.springer.de/data/pubftp/pub/tex/latex/llncs/latex2e/llncsdoc.pdf
%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%


\documentclass[runningheads,a4paper]{llncs}

\usepackage{amssymb}
\setcounter{tocdepth}{3}
\usepackage{graphicx}

\usepackage{url}
\urldef{\mailsa}\path|{alfred.hofmann, ursula.barth, ingrid.haas, frank.holzwarth,|
\urldef{\mailsb}\path|anna.kramer, leonie.kunz, christine.reiss, nicole.sator,|
\urldef{\mailsc}\path|erika.siebert-cole, peter.strasser, lncs}@springer.com|    
\newcommand{\keywords}[1]{\par\addvspace\baselineskip
\noindent\keywordname\enspace\ignorespaces#1}

\begin{document}

\hyphenation{wiki-space}

\mainmatter  % start of an individual contribution

% first the title is needed
\title{Collaborative Structuring of Knowledge\\ by Experts and the Public}

% a short form should be given in case it is too long for the running head
\titlerunning{Collaborative Structuring of Knowledge by Experts and the Public}

% the name(s) of the author(s) follow(s) next
%
% NB: Chinese authors should write their first names(s) in front of
% their surnames. This ensures that the names appear correctly in
% the running heads and the author index.
%
\author{Tom Morris\inst{1}%
%\thanks{Please note that the LNCS Editorial assumes that all authors have used
%the western naming convention, with given names preceding surnames. This determines
%the structure of the names in the running heads and the author index.}%
\and Daniel Mietchen\inst{2}}
%
\authorrunning{Tom Morris and Daniel Mietchen}

% the affiliations are given next; don't give your e-mail address
% unless you accept that it will be published
\institute{\url{http://www.citizendium.org/User:Tom_Morris}
\and
\url{http://www.citizendium.org/User:Daniel_Mietchen}\\Correspondence: Daniel.Mietchen (at) uni-jena (dot) de }

%\institute{Springer-Verlag, Computer Science Editorial,\\
%Tiergartenstr. 17, 69121 Heidelberg, Germany\\
%\mailsa\\
%\mailsb\\
%\mailsc\\
%\url{http://www.citizendium.org/User:Tom_Morris}}
%\url{http://www.citizendium.org/User:Tom_Morris\\http://www.citizendium.org/User:Daniel_Mietchen\\}}

%
% NB: a more complex sample for affiliations and the mapping to the
% corresponding authors can be found in the file "llncs.dem"
% (search for the string "\mainmatter" where a contribution starts).
% "llncs.dem" accompanies the document class "llncs.cls".
%

\toctitle{Collaborative Structuring of Knowledge by Experts and the Public}
\tocauthor{Tom Morris and Daniel Mietchen}
\maketitle


\begin{abstract}
There is much debate on how public participation and expertise can be brought together in collaborative knowledge environments. One of the experiments addressing the issue directly is Citizendium. In seeking to harvest the strengths (and avoiding the major pitfalls) of both user-generated wiki projects and traditional expert-approved reference works, it is a wiki to which anybody can contribute using their real names, while those with specific expertise are given a special role in assessing the quality of content. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates. We provide an overview of how Citizendium is structured and what it offers to the open knowledge communities, particularly to those engaged in education and research. Special attention will be paid to the structures and processes put in place to provide for transparent governance, to encourage collaboration, to resolve disputes in a civil manner and by taking into account expert opinions, and to facilitate navigation of the site and contextualization of its contents.
\keywords{open knowledge, open education, open science, open \\governance, wikis, expertise, Citizendium, Semantic Web}
\end{abstract}


\section{Introduction}

\begin{quote}
{\it Science is already a wiki if you look at it a certain way. It's just a highly inefficient one -- the incremental edits are made in papers instead of wikispace, and significant effort is expended to recapitulate existing knowledge in a paper in order to support the one to three new assertions made in any one paper.  } \begin{flushright} John Wilbanks \cite{Wilbanks2009}
\end{flushright}\end{quote}

There are many ways to structure knowledge, including collaborative arrangements of digital documents. Only a limited number of the latter ones have so far been employed on a larger scale. Amongst them are wikis~-- online platforms which allow the aggregation, interlinking and updation of diverse sets of knowledge in an Open Access manner, i.e. with no costs to the reader. 

\subsection{Wikis as an example of public knowledge environments online}

As implied by the introductory quote, it is probably fair to say that turning science (or any system of knowledge production, for that matter) into a wiki (or a set of interlinked collaborative platforms) would make research, teaching and outreach much more transparent, less prone to hype, and more efficient. Just imagine you had a time slider and could watch the history of research on general relativity, plate tectonics, self-replication, or cell division unfold from the earliest ideas of their earliest proponents (and opponents) onwards up to you, your colleagues, and those with whom you compete for grants. So why don't we do it?

Traditionally, given the scope of a particular journal, knowledge about specialist terms (which may describe completely non-congruent concepts in different fields), methodologies, notations, mainstream opinions, trends, or major controversies could reasonably be expected to be widespread amongst the audience, which reduced the need to redundantly say and then repeat the same things all over again and again (in cross-disciplinary environments, there is a higher demand for proper disambiguation of the various meanings of a term). Nonetheless, redundancy is still quite visible in journal articles, especially in the introduction, methods, and discussion sections and the abstracts, often in a way characteristic of the authors (such that services like eTBLAST and JANE can make qualified guesses on authors of a particular piece of text, with good results if some of the authors have a lot of papers in the respective database, mainly PubMed, and if they have not changed their individual research scope too often in between).

A manuscript well-adapted to the scope of one particular journal is often not very intelligible to someone outside its intended audience, which hampers cross-fertilization with other research fields (we will get back to this below). When using paper as the sole medium of communication there is not much to be done about this limitation. Indeed, we have become so used to it that some do not perceive it as a limitation at all. Similar thoughts apply to manuscript formatting. However, the times when paper alone reigned over scholarly communication have certainly passed, and wiki-like platforms provide for simple and efficient means of storing information, updating it and embedding it into a wider context.

Cross-field fertilization, for example, is crucial with respect to interdisciplinary research projects, digital libraries and multi-journal (or indeed cross-disciplinary) bibliographic search engines (e.g. Google Scholar), since these dramatically increase the likelihood of, say, a biologist stumbling upon a not primarily biological source relevant to her research (think shape quantification or growth curves, for instance). What options do we have to systematically integrate such cross-disciplinary hidden treasures with the traditional intra-disciplinary background knowledge and with new insights resulting from research?

The by now classical example of a wiki environment are the Wikipedias, a set of interlinked wikis in multiple languages where basically anyone can edit any page, regardless of subject matter expertise or command of the respective language. As a consequence of this openness, the larger Wikipedias have a serious problem with vandalism: take an article of your choice and look at its history page for reverts - most of them will be about neutralizing subtle or blunt forms of destructive edits that do nothing to improve the quality of the articles, but may reduce it considerably. Few of these malicious edits persist for long  \cite{Priedhorsky:2007}, but finding and fixing them takes time that could better be spent on improving articles. This is less of an issue with more popular topics for which large numbers of volunteers may be available to correct "spammy" entries but it is probably fair to assume that most researchers value their time too much to spend it on repeatedly correcting information that had already been correctly entered. Other problems with covering scientific topics at the Wikipedias include the nebulous notability criteria which have to be fulfilled to avoid an article being deleted, and the rejection of "original research" in the sense of not having been peer reviewed before publication. Despite these problems, one scientific journal~-- RNA Biology~-- already requires an introductory Wikipedia article for a subset of papers it is to publish \cite{RNABiol}.

Peer review is indeed a central aspect of scholarly communication, as it paves the way towards the reproducibility that forms one of the foundations of modern science. Yet we know of no compelling reason to believe that it works better before than after the content concerned has been made public (doing it beforehand was just a practical decision in times when journal space was measured in paper pages), while emerging movements like Open Notebook Science~-- where claims are linked directly to the underlying data that are being made public as they arise~-- represent an experiment in this direction whose initial results look promising and call into question Wikipedia's "no original research" as a valid principle for generating encyclopaedic content.

Although quite prominent at the moment, the Wikipedias are not the only wikis around, and amongst the more scholarly inclined alternatives, there are even a number of wiki-based journals, though usually with a very narrow scope and/or a low number of articles. On the other hand, Scholarpedia (which has classical peer review and an ISSN and may thus be counted as a wiki journal, too \cite{Scholarpedia}), OpenWetWare \cite{OpenWetWare}, Citizendium \cite{Citizendium} and the Wikiversities \cite{Wikiversity} are cross-disciplinary and structured (and of a size, for the moment) such that vandalism and notability are not really a problem. With minor exceptions, real names are required at the first three, and anybody can contribute to entries about anything, particularly in their fields of expertise. None of these is even close to providing the vast amount of context existing in the English Wikipedia but the difference is much less dramatic if the latter were broken down to scholarly useful content. Out of these four wikis, only OpenWetWare is explicitly designed to harbour original research, while the others allow different amounts thereof. Furthermore, a growing number of yet more specialized scholarly wikis exist (e.g. WikiGenes \cite{WikiGenes}, the Encyclopedia of Earth \cite{EoEarth}, the Encyclopedia of Cosmos \cite{EoCosmos}, the Dispersive PDE Wiki \cite{Dispersive-PDE}, or the Polymath Wiki \cite{Polymath}), which can teach us about the usefulness of wikis within specific academic fields. 

\section{The Citizendium model of wiki-based collaboration}
Despite the above-mentioned tensions between public participation and expertise in the collaborative structuring of knowledge, it is not unreasonable to expect that these can be overcome by suitably designed public knowledge environments, much like Citizen Science projects involve the public in the generation of scientific data. One approach at such a design is represented by Citizendium. The founder of Citizendium~-- Larry Sanger~-- is the co-founder of Wikipedia. The two projects share the common goal of providing free knowledge to the public, they are based on variants of the same software platform, and they use the same Creative Commons-Attribution-Share Alike license \cite{CC-BY-SA}. Yet they differ in a number of important ways, such that Citizendium can be seen as composed of a Wikipedia core (stripped down in terms of content, templates, categories and policies), with elements added that are characteristic of the other wiki environments introduced above: A review process leading to stable versions (as at Scholarpedia), an open education environment (as at Wikiversity) and an open research environment (as at OpenWetWare). Nonetheless, assuming that the reader is less familiar with these three latter environments, we will follow previous commenters and frame the discussion of Citizendium in terms of properties differentiating it from Wikipedia, and specifically the latter's English language branch \cite{Wikipedia:En}. 

\subsection{Real names}
The first of these is simply an insistence on real names. While unusual from a Wikipedia perspective, this is custom in professional environments, including traditional academic publishing and some of the above-mentioned wikis, e.g. Scholarpedia and Encyclopedia of Earth. It certainly excludes a number of legitimate contributors who prefer to remain anonymous but otherwise gives participants accountability and allows to bring in external reputation to the project. 

\subsection{Expert guidance}

\begin{figure}
\centering
\includegraphics[width=12.2cm]{Approved}
\caption{Screenshot of the main page of the [[Crystal Palace]] cluster while logged in using a monobook skin that is the default at Wikipedia. It shows the \textit{green cluster bar} that indicates that the page has been approved and links to all the supages. Also visible is the \textit{status indicator} (green dots on the left topped by green tick), mention of \textit{"an editor"} to distinguish the number of editors involved (some pages can be approved by one rather than three editors), links to the workgroups which have approval rights for the article (in this case: the \textit{History and Architecture Workgroups}), a prominent \textit{disclaimer} (unapproved articles have a much strong disclaimer), and links to the 'unstable' \textit{draft} version of the article which any registered contributor can update. Like traditional encyclopaedic environments, Citizendium does not require every statement to be referenced, in the interest of narrative flow.}
\label{fig:Approved}
\end{figure}
To compose and develop articles and to embed them in the multimedial context of a digital knowledge environment, expert guidance is important. Of course, many experts contribute to Wikipedia, and the Wikipedias in turn have long started to actively seek out expert involvement, yet the possibility to see their edits overturned by anonymous users that may lack even the most basic education in that field keeps professionals away from spending their precious time on such a project. The Citizendium approach of verifying expertise takes a different approach~-- sometimes termed "credentialism"~-- that rests on a common sense belief that some people do know more than others: it is sometimes the case that the thirteen-year-old kid in Nebraska does know more than the physics professor. But most of the time, at least when matters of physics are concerned, this is not the case. The role the experts have at Citizendium is not, as frequently stated in external comments, that of a supreme leader who is allowed to exercise his will on the populace. On the contrary, it is much more about guiding. We use the analogy of a village elder wandering around the busy marketplace \cite{Basar} who can resolve disputes and whom people respect for their mature judgement, expertise and sage advice. Wikipedia rejects "credentialism" in much the same way that the Internet Engineering Task Force (IETF) does. David Clark summarised the IETF process thusly \cite{Clark:1992}: "We reject kings, presidents and voting. We believe in rough consensus and running code." In an open source project, or an IETF standardisation project, one can decide a great many of the disputes with reference to technical reality: the compiler, the existing network protocols etc. If the code doesn't compile, think again. For rough consensus to happen under such circumstances, one needs to get the people together who have some clear aim in mind: getting two different servers to communicate with one another. The rough consensus required for producing an encyclopaedia article is different~-- it should attempt to put forward what is known, and people disagree on this to a higher degree than computers do on whether a proper connection has been established. It is difficult to get "rough consensus, running code" when two parties are working on completely different epistemological standards. At this point, one needs the advice of the village elderly who will vet existing content and provide feedback on how it can be expanded or otherwise improved. Upon fulfillment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by non-specialists, these vetted entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates (cf.\ Fig.\ \ref{fig:Approved}).

The respect for experts because of their knowledge of facts is only part of the reasoning: the experts point out and correct factual mistakes, but they also help to guide the structuring of content within an article and by means of the subpages. The experts bring with them the experience and knowledge of years of in-depth involvement with their subject matter, and the project is designed to make best use of this precious resource, while still allowing everyone to participate in the process. Of course, experts are likewise free to bring in content, be it within their specialty or in other areas, where others take over the guiding role. The Citizendium can also host 'Signed Articles', which are placed in a subpage alongside the main article. A Signed Article is an article on the topic described by a recognised expert in the field, but can express opinions and biases in a way that the main article ought not to.


\begin{figure}
\centering
\includegraphics[width=11.2cm]{Related-Approved}
\includegraphics[width=11.2cm]{Lemma}
\caption{{\bf Top:} Screenshot of the Related Articles subpage from the [[Biology]] cluster (which is approved) while logged in. It shows the \textit{Parent topics} and the first section of the \textit{Subtopics}~-- \textit{subdisciplines}. For each related article, there is a short definition or description of the topic, and a link to its Related Articles subpage (hidden behind the \textit{[r]}), as well as instructions on mouseover and a Table of \textit{Content}. {\bf Bottom:} Related Articles subpage from the [[Open Knowledge Conference]] cluster (while logged out) which has not yet been converted to subpage style but can already be used for structuring information related to the topic. In principle, on could also think of adding [[Open Knowledge Conference 2010]] as a subtopic and using this article for conference blogging. However, the current MediaWiki software cannot handle parallel editing by multiple users, though tools like Etherpad \cite{Etherpad} have shown that it is feasible.}
\label{fig:Related-Approved}
\end{figure}

\subsection{Contextualization}
Citizendium attempts to structure knowledge in a different way. Each article on Citizendium can make comprehensive use of Subpages, i.e. pages providing additional information that are subordinate to an article's page. Some of these~-- e.g. the Sculptures subpage in Fig.\ \ref{fig:Approved}~-- are similar to but more flexible than the supplementary online materials now being published routinely along scholarly articles. Two subpages types are different, with keywords  and running title being the closest analogues from academic papers: All pages are encouraged to have a short Definition subpage (around 30 words or 150 characters) which defines or describes the subject of the page. They are also encouraged to have a comprehensive Related Articles subpage, which uses templates to pull in the definitions from the pages that it links to (a feature that relies on the absence of vandalism). If one looks at the Related Articles subpage of [[Biology]] (cf.\ Fig.\ \ref{fig:Related-Approved}, top), one can see the parent topics of biology (science), the subtopics - subdisciplines of biology like zoology, genetics and biochemistry, articles on the history of biology and techniques used by biologists - and finally other related topics, including material on the life cycle, the various biochemical substances like DNA and proteins, the components of the cell, and other specialised language. This Related Articles page gives a pretty comprehensive contextual introduction to what biology is all about, and is structured by the authors of the article in a way that is consistent across the site (cf.\ Fig.\ \ref{fig:Related-Approved}, bottom). This goes beyond Wikipedias categories, "See also" sections and ad-hoc infoboxes. Citizendium's approach can be considered as an exploratory next step towards linking encyclopaedic content with the Semantic Web. 

Subpages (a further usage example is in (cf.\ Fig.\ \ref{fig:Spellings}) are one way in which Citizendium is attempting to go beyond what is provided in either traditional paper-based encyclopaedias or by Wikipedia: to engage with context, with related forms of knowledge, and to emancipate knowledge from the page format to which it was confined in the print era. Marx wrote that "Philosophers have hitherto only interpreted the world in various ways; the point is to change it" \cite{Marx}. Traditional encyclopaedias attempt to reflect the world, but we are attempting to go further. The open science movement - which has formed around the combination of providing open access to journal articles, making scientific data more openly available in raw forms, using and sharing open source software and experimenting with some of the new techniques appearing from the community that is formed under the 'Web 2.0' banner - is exploring the edge of what is now possible for scientists to do to create new knowledge. Some of the electronic engagements by academics has been for actual research benefit, some has just been PR for universities - doing podcasts to sound 'relevant'. The Citizendium model, while a little bit more traditional than some of the open science platforms, is willing to try a variety of new things. Wikipedia has produced a pretty good first version of a collaboratively written encyclopedia~-- the challenge is to see if we can go further and produce a citizens' compendium of structured and comprehensive knowledge and update it as new evidence or insights arise. 

\begin{figure}
\centering
\includegraphics[width=12.2cm]{Spellings-Main}
\includegraphics[width=12.2cm]{Spellings-Catalog}
\caption{{\bf Top:} Screenshot of the main page of the [[English spellings]] cluster while logged out. It shows the \textit{blue cluster bar} that indicates that the page has not been approved and links to  all the supages. Also visible is the \textit{status indicator} (red dots on the left topped by grey dots, indicating the status of a 'developing' article), and a stronger \textit{disclaimer} than on approved pages. Below this standard header, a set of templates links to 'Catalog' subpages that collect links, for each letter of the English alphabet, to \textit{Alphabetical} and \textit{Retroalphabetical} lists of spellings, to lists of \textit{Common misspellings} as well as to an article on the specific \textit{Letter}. {\bf Bottom:} Close-up of the Catalogs subpage hosting the retroalphabetical list of English spellings for the letter T, again cross-linked with all the other subpages in that cluster.}
\label{fig:Spellings}
\end{figure}

\subsection{Open governance}
Citizendium has an evolving, but hopefully soon-to-be clearly defined governance process - a Charter is in the process of being drafted by an elected group of writers that will allow for democratic governance and oversight. The broad outline is this: we will have a democratically elected Editorial Council which will deal with content policy and resolving disputes regarding content, and we will also have a Management Committee, responsible for anything not related to content. The Management Committee appoint Constables who uphold community policy regarding behaviour. Disputes with the Constables can be brought to an Ombudsman selected by the Editorial Council and Management Committee. At the time of writing, the charter is still to be ratified by the community. One of the reasons we have this is that although there is a cost to having bureaucracy and democracy, the benefits of having an open governance process outweigh the costs. We have a real problem when governments of real-life communities are controlled by shadowy cabals who invoke byzantine legal codes - all the same problems would seem to apply to online communities. With a Wikipedia article, the debate seems to shift very quickly from the truth value or relevance of the content itself into often ritualized arguments about acronyms (AfDs, NPOV, CSD, ArbCom, OR etc.). There is always a challenge in any knowledge-based community in attempting to reconcile a fair and democratic process with a meritocratic respect for expertise. There are no easy answers - if we go too far towards bureaucracy, we risk creating a system where management is separated from the actual day-to-day writing of the site, while if we attempt to let the site 'manage itself', we risk creating a rather conservative mob rule that doesn't afford due process to interested outsiders. A more traditional management structure, combined with real names and civility, should help those outside of the online community - the many experts in real life who work in universities, in business and in public life - to participate on an equal footing. Hopefully, if we get the governance decisions right, we can also not get in the way of the people who engage on hobbyist terms with Citizendium. 

\subsection{Open education}
An important part of the governance process is collaboration with partners external to the Citizendium. One of our initiatives~-- called Eduzendium~-- provides for educators in higher education to assign work on wiki articles as part of a course. We have most recently had politics students from the Illinois State University work on articles on pressure groups in American public life, as well as medical students from Edinburgh, biologists from City University of New York and the University of Colorado at Boulder, finance students from Temple University and others. These courses reserve a batch of articles for the duration of the course, and assign each article to one or more students. The course instructor can reserve the articles for just the group of students enrolled in the course, or invite the wider Citizendium community to participate. Much of the formatting is achieved via course-specific templates that can be generated semi-automatically by the instructor and applied throughout the course pages, so that course participants can concentrate on content.
    
\section{Open questions}
The project is still young, resulting in a number of challenges and opportunities. In many fields, Citizendium does not meet our own standards~-- we do not have a full range of expert editors. Larry Sanger once envisioned that Citizendium could reach 100,000 articles by 2012. This would, on average, require about 150 new articles a day to reach; the current level is around 15. It is not obvious how the necessary shift from linear to exponential growth can be achieved.

Motivating both editors and authors to take part in both writing and approving of content remains a difficult challenge~-- most experts have very little time to offer for projects that do not contribute to the metrics according to which their performance is evaluated, and others shy away from contributing under their real name and in the presence of experts. Another problem is that the initial structure of the community, and the nature of its interaction with Wikipedia, has led to a few articles on popular pseudoscientific topics which are hard to handle from an editorial perspective because those willing to invest their time on the topics are usually heavily biased in their approach, and most of those capable of evidence-based comment prefer not to contribute to these topics.

The project also needs to allow for more feedback by non-registered readers, without harming the currently very collegial atmosphere that is to a large extent due to the real-name policy and the respect for expertise. We may need to explore how to codify our core policies and collaboration model as a possible MediaWiki extension, from which other wikis could possibly benefit~-- online, "code is law" \cite{Lessig}, as is currently being highlighted by sites like Stack Overflow which have changed the social interactions of participants by changing formal features of user experience and social structure.  We need to find financial backing and support. So far, the project has been run on a basically volunteer-only basis, yet the envisioned growth and improvement of English-language content and the possible start of branches in other languages require a higher degree of professionalisation, for which the upcoming Charter is meant as a basis.
    
\section{Open perspectives}

Citizendium is open for partnerships with other open science and online knowledge communities and projects. Possible candidate projects would include, for instance, AcaWiki \cite{AcaWiki} for references, OpenWetWare for primary research, and Open Access journals \cite{DOAJ} as possible content providers, and of course the Wikipedias and other public wikis for exchange on matters of content management, community development and user experience. The key strength we think the Citizendium model brings is a greater focus on knowledge contextualization: it will be interesting to see whether we can evolve the social model for knowledge production to keep up with changes in the technological possibilities. Many in the Citizendium community are looking forward to working alongside both academics and those working in the Semantic Web community to tie Citizendium into data projects. We feel that despite the commoditization of Web 2.0 technologies, there is still plenty of opportunities for reinventing and experimenting with new ways to render and collaborate on knowledge production and to see if we can build a more stable, sustainable and collegial atmosphere~-- with democratic and meritocratic elements~-- for experts and the public to work together.

\subsubsection*{Acknowledgments.} The authors wish to thank Russell D. Jones, Howard C. Berkowitz, Steven Mansour and Peter Schmitt for critical comments on earlier versions of this draft as well as Claudia Koltzenburg, Fran\c{c}ois Dongier and Charles van den Heuvel for helpful discussions. 

\begin{thebibliography}{4}

\bibitem{AcaWiki} AcaWiki,\\ \url{http://acawiki.org/} \\All URLs referenced in this article were functional as of March 31, 2010.

\bibitem{Citizendium} Citizendium,\\ \url{http://www.citizendium.org/}

\bibitem{Clark:1992} Clark, D.: Plenary lecture, "A Cloudy Crystal Ball~-- Visions of the Future", Proc. 24th IETF: 539 (1992),\\ \url{http://www.ietf.org/proceedings/prior29/IETF24.pdf}

\bibitem{CC-BY-SA} Creative Commons-Attribution-Share Alike license 3.0,\\ \url{http://creativecommons.org/licenses/by-sa/3.0/}

\bibitem{DOAJ} Directory of Open Access Journals,\\ \url{http://www.doaj.org/}

\bibitem{Dispersive-PDE} Dispersive PDE Wiki,\\ \url{http://tosio.math.utoronto.ca/wiki/}

\bibitem{EoCosmos}  Encyclopedia of Cosmos,\\ \url{http://www.cosmosportal.org/}

\bibitem{EoEarth} Encyclopedia of Earth,\\ \url{http://www.eoearth.org}

\bibitem{Etherpad} Etherpad source code,\\ \url{http://code.google.com/p/etherpad/}

\bibitem{Lessig} Lessig, Lawrence: Code and Other Laws of Cyberspace,\\ \url{http://codev2.cc/}

\bibitem{Marx} Marx, Karl: Theses on Feuerbach,\\ \url{http://www.marxists.org/archive/marx/works/1845/theses/theses.htm}

\bibitem{OpenWetWare} OpenWetWare,\\ \url{http://www.openwetware.org/}

\bibitem{Polymath} Polymath WIki,\\ \url{http://michaelnielsen.org/polymath1/}

\bibitem{Priedhorsky:2007}
Priedhorsky R, Chen J, Lam STK, Panciera K, Terveen L, et~al. (2007) Creating,
  destroying, and restoring value in wikipedia.
In: GROUP '07: Proceedings of the 2007 international ACM conference
  on Supporting group work. New York, NY, USA: ACM, pp. 259--268.
\url{http://doi.acm.org/10.1145/1316624.1316663}.

\bibitem{Basar} Raymond, Eric S.: The Cathedral and the Bazaar, \\ \url{http://www.catb.org/~esr/writings/homesteading/}
 
\bibitem{RNABiol} RNA Biology, Guidelines for the RNA Families Track,\\ \url{http://www.landesbioscience.com/journals/rnabiology/guidelines/}

\bibitem{Scholarpedia} Scholarpedia,\\ \url{http://www.scholarpedia.org/}

\bibitem{WikiGenes} WikiGenes,\\ \url{http://www.wikigenes.org/} 

\bibitem{Wikipedia:En} English Wikipedia,\\ \url{http://en.wikipedia.org} 

\bibitem{Wikiversity} Wikiversity,\\ \url{http://www.wikiversity.org} 

\bibitem{Wilbanks2009} Wilbanks, J.: Publishing science on the web,\\ \url{http://scienceblogs.com/commonknowledge/2009/07/publishing_science_on_the_web.php}

\end{thebibliography}

\end{document}
Retrieved from "https://citizendium.org/wiki/index.php?title=User:Daniel_Mietchen/Sandbox/Open_Knowledge_Conference_2010&oldid=733672"