Research:Newsletter/2016/September

Template:Signpost draft{{Wikipedia:Signpost/Template:Signpost-header|||}}

{{Wikipedia:Signpost/Template:Signpost-article-start|Wikipedia dispute index a mixed bag|By Piotr Konieczny and Tilman Bayer| 15 September 2016}}

Vol: {{{1}}} • Issue: {{{2}}} • {{{3}}} [contribute] [archives]

{{{4}}}

"Wikipedia Dispute Index" detects high-conflict countries

This study^[1] (from 2011, but not covered by the Signpost at the time) explores the following question: given that a number of online predictors have been associated with online events (ex. Google searches can be used to monitor the spread of infectious diseases), can we use use Wikipedia's metadata for similar insights? Hence the author attempts to test whether Wikipedia content disputes can be used to understand real-life conflicts. The authors analyzed all pages linking to articles about countries that had the "NPOV dispute" tag, through they note that only about a quarter (138 of 497) entities had a sufficient number of conflicts to allow further analysis. (This reviewer wonders why the authors chose the "what links here" tool rather than the more precise category of WikiProject template groups of articles; a cursory look at the 100+ articles linked to Poland, for example, suggests that only ~20% are clearly related to that country.)

They then created a "Wikipedia Dispute Index" (downloadable image of the index heat map), which measures whether a country has more or less then an average disputes linking to it. The authors note that their index roughly matches the "1996–2008 World Bank Policy Research Aggregate Governance Indicators" and the "Economist Intelligence Unit 2009 Political Instability Index" (downloadable image of the correlation plots between those indexes – not bad, given the underlying problem of using "what links here" as a dataset). The results indicate that "the most disputed are parts of the middle east followed by other regions such as Kosovo, Bosnia & Herzegovina and North Korea ..., countries in North America and Western Europe are the least disputed, with most other countries occupying a middle range." With regards to the type of conflicts, they observe that "the biggest contributors to the indicator tend to be disputes over current or historical events or individuals that vary according to different political views."

Though the authors present no convincing arguments about why exactly their index would be more or less useful then the existing ones, they write that it can be seen as a supplementary tool validating other indexes, and conclude that Wikipedia's data and metadata can be used to generate other useful indexes and metrics – something that this reviewer certainly agrees with.

Wikipedians may find the following page created for this project useful (for the next few years until it inevitably goes down as it stops being maintained – perhaps somone could contact the authors about moving it to the Toolserver/Labs?: http://www.disputeindex.org/ which displays the (gray and white) heatmap and lists Wikipedia articles that are being analyzed – a nice visual gadget for our internal cleanup purposes)

Briefly

Conferences and events

See the research events page on Meta-wiki for upcoming conferences and events, including submission deadlines.

Other recent publications

A list of other recent publications that could not be covered in time for this issue—contributions are always welcome for reviewing or summarizing newly published research.

• "The Impact and Evolution of Group Diversity in Online Open Collaboration"^[2] From the abstract: "we examine 648 WikiProjects to understand (1) how tenure disparity and interest variety affect group productivity and member withdrawal and (2) how the two types of diversity evolve over time. Our results show a curvilinear effect of tenure disparity, which increases productivity and decreases member withdrawal, up to a point. Beyond that point, productivity slightly decreases, and members are more likely to withdraw."
• "Helping Wikipedia versus Helping a WikiProject: Subgroup Dynamics, Member Contribution and Turnover in Online Production Communities"'^[3] From the abstract: "we analyze data from 648 WikiProjects and the archived behaviors of 14,464 member editors ... Our results reveal two critical trade-offs in managing online production communities. First, a number of factors that increase member contribution such as tenure dissimilarity and past contribution also increase one’s likelihood of leaving the community, perhaps due to conflict or feelings of “mission accomplished” or “burnout”. Second, individual membership in multiple projects has mixed and largely negative effects. It decreases the amount of work editors contribute to both the individual projects and Wikipedia as a whole. It reduces one’s likelihood of leaving individual project yet increases the likelihood of leaving Wikipedia as a whole."
• "Transforming Wikipedia into an Ontology-based Information Retrieval Search Engine for Local Experts using a Third-Party Taxonomy"^[4] From the abstract: "Using a third-party taxonomy, independent from Wikipedia's category hierarchy, we index information connected to our local experts, present in their activity reports, and we re-index Wikipedia content using the same taxonomy. ... A Wikipedia gadget (or plugin) activated by the interested user, accesses the endpoint as each Wikipedia page is accessed. An additional tab on the Wikipedia page [developed using ResourceLoader allows the user to open up a list of teams of local experts associated with the subject matter in the Wikipedia page. "
• "'An Encyclopedia, Not an Experiment in Democracy': Wikipedia Biographies, Authorship, and the Wikipedia Subject"^[5] From the abstract: "Wikipedia biography is a culturally significant, yet overlooked form of digital life narrative. Through an examination of Wikipedia’s policies and discussion forums, and a number of its most popular and controversial biographies, this essay explores the politics of biographical practice and representation on the site."
• "Networked knowledge : approaches to analyzing dynamic networks of knowledge in wikis for mass collaboration"^[6] From the abstract: "[This] work builds on a theoretical consideration of collaborative learning and knowledge building stemming from the interdisciplinary learning sciences and research on computer-supported collaborative learning (CSCL) in particular. ... A complex systems perspective is used to explain knowledge as an emergent phenomenon ... Based on these conceptualizations, the present dissertation empirically examines large real-life data sets from the online communities Wikipedia and Wikiversity. Knowledge is captured as a network of interconnected articles in different knowledge domains."
• "Wikipedia and conceptions of knowledge in encyclopaedism"^[7] From the "Methodology" section: "Wikipedia [is] broken down genealogically, historically and structurally. [Then,] we study more specific epistemological aspects and problems within Wikipedia. The workings of Wikipedia will be confronted with different epistemological and hermeneutic interpretations of what knowledge is, how it works and how it is organised. ... Before concluding, the previous findings will be used to judge the effect of Wikipedia upon its cultural surroundings."

References

1. Apic, Gordana; Betts, Matthew J.; Russell, Robert B. (2011-06-22). "Content Disputes in Wikipedia Reflect Geopolitical Instability". PLOS ONE 6 (6): –20902. ISSN 1932-6203. doi:10.1371/journal.pone.0020902. 
2. Ren, Yuqing; Chen, Jilin; Riedl, John (2015-08-28). "The Impact and Evolution of Group Diversity in Online Open Collaboration". Management Science. ISSN 0025-1909. doi:10.1287/mnsc.2015.2178. 
3. Ren, Yuqing; Riedl, John. Helping Wikipedia versus Helping a WikiProject: Subgroup Dynamics, Member Contribution and Turnover in Online Production Communities (PDF). University of Minnesota. p. 32.  (working paper)
4. Grefenstette, Gregory; Rafes, Karima (2016-05-23). Transforming Wikipedia into an Ontology-based Information Retrieval Search Engine for Local Experts using a Third-Party Taxonomy. Joint Second Workshop on Language and Ontology & Terminology and Knowledge Structures (LangOnto2 + TermiKS) LO2TKS. 
5. Graham, Pamela (2015). ""An Encyclopedia, Not an Experiment in Democracy": Wikipedia Biographies, Authorship, and the Wikipedia Subject". Biography 38 (2): 222–244. ISSN 1529-1456. doi:10.1353/bio.2015.0023. 
6. Halatchliyski, Iassen (2015). "Networked knowledge : approaches to analyzing dynamic networks of knowledge in wikis for mass collaboration". doi:10.15496/publikation-6005.  (dissertation at the University of Tübingen)
7. Hastings Ruiz, David Robert (2015). "Wikipedia and conceptions of knowledge in encyclopaedism".  (dissertation)

{{Wikipedia:Signpost/Template:Signpost-article-comments-end||2016-09-06|}}