Board faces diversity and skill-base issues in new FDC appointments
Nominations for four new seats on the Funds Dissemination Committee (FDC) have just closed. The FDC is a volunteer WMF body that strongly influences how a high proportion of donors' funds are spent. The Committee was created in 2012 after the Foundation Board stopped all but a few chapters from directly processing donations raised on its behalf. The move brought the review and funding of most "eligible" affiliates under more centralised community review, and the FDC has since been the primary instrument for scrutinising their applications for recurrent operating expenses, and recommending to the Board who should get what. Thus far the Board has accepted all of the FDC's recommendations from the twice-yearly application rounds.
The FDC has been no stranger to controversy. In late 2015, with the Foundation in turmoil over issues of governance, funding, and leadership, the FDC stepped outside its official mandate to publish a scathing critique of the WMF’s performance. This step was well received: the WMF accepted and acted on the feedback (video 14:27), and invited the FDC’s comments in the subsequent funding round.
The FDC's two-year memberships have been designed around a leap-frogging process of yearly alternating Board appointments of four volunteer voting members and community elections of five volunteer voting members. In addition, the Board maintains a close relationship with the FDC through the appointment of two of its own members as non-voting FDC members (currently ex-chair of the FDC, Dariusz Jemielniak and Guy Kawasaki), and the participation of three non-voting staff members in FDC processes (Katy Love, Winifred Olliff, and Delphine Ménard, herself a former voting member of the FDC).
Current round
The current round is for the four Board appointments, and has attracted 13 self-nominees. Nominations closed just over a week ago, after which there was a short public Q&A. FDC staff will now confer with the two FDC board representatives to draw up a shortlist by 5 August; a decision on the final four candidates will be finalised in consultation with the Board, and announced 2 September. In the last, 2014 round of Board appointments, the factors weighed up by the Board's were reported by a Trustee as: "solid Wikimedia contributions (online or offline); complementary non-Wikimedia background, some in finance or budgeting or program evaluation/review (not all though and that's not a must); grantmaking/reviewing experience in Wikimedia; chapter leadership/exec experience or non-chapter contributor; geographical, age, language, wiki diversity; reasoned, analytical responses to the Q&A on Meta and during the interviews."
The FDC's charter explicitly requires membership diversity; in practice, this has clearly been a stumbling block, probably for a complex set of reasons that are difficult to resolve. Of the five ongoing voting members (recommended last year via community election), two are native-speakers of English, all are males, and all are from the global north; of the four whose terms are about to become vacant, two are native-speakers of English, three are males, and three are from the global north (depending on how the south–north boundary is defined). Among the 13 nominees, six declare themselves to be native-speakers of English and nine as male, with roughly eight from the global north.
Questions from Wikimedia community members involved the duties of Wikimedia affiliates regarding paid editing; depth of experience in evaluating grants; diversity (specifically, geographic and gender); the need for innovation, its tension with evaluating success by standard measures, and the value in sharing stories of successes and failures; the nature of what FDC money should fund; and its relation to the committee’s volunteer community.
Two candidates came to Wikimedia through high-profile roles with the WMF (which they have since left): Garfield Byrd as chief financial officer, and Bishakha Datta as trustee. Several have extensive experience in Wikimedia governance, including past service on the FDC itself. Several women, and several candidates from the global south, could increase the diversity of perspectives on the FDC. Some have very little experience with editing wikis, and point to their professional backgrounds for their main qualifications. Along with this elaborate matrix of backgrounds, the staff and Board will need to factor in the relevant expertise and experience required by a task that at certain times during the year will require a full-time effort by members. Former chair of the FDC and now member of the WMF Board, Dariusz Jemielniak, posed a significant question to all candidates on the Q and A page:
| ... the FDC requires a lot of past experience in evaluating grants (not just writing grant proposals, which also is a must, but of having had a chance to read and compare 100+ applications for money), or extensive professional background in management, strategy, finance, or auditing. |
Jemielniak asked for nominees' attitudes to this proposition, and how they saw their background in relation to it. There was surprising variety in the responses, revealing something of a clash of cultures between valuing on-the-ground programmatic experience and professional, technocratic expertise, although some nominees emphasised the need for both dimensions to be represented on the Committee. One answer asserted a strongly different view of the importance of grantmaking experience:
| Some of the best grantmakers I've worked with in foundations had none of these skills. But they had other skills needed to make good grants. They had domain knowledge or expertise. They had a vision. |
The other answers echoed one or both of these positions, reflecting a range of views of the relative merits of grantmaking experience and programmatic experience.
The Board and FDC staff face a range of competing needs in their judgment of the nominations. Not only are there issues of diversity and grantmaking-related professional skills; there is the need to prepare the FDC, and grantmaking more broadly, to grapple with deeper issues over time. Among these are the inherent difficulty of predicting and measuring impact-value for money of programmatic activities on WMF sites and their readers; and the likelihood that we are entering a period in which the model for fundraising is under challenge. – T and P
Geoff Brigham departs
With regret, the Signpost passes on the news that Geoff Brigham finished up on 18 July as general counsel and secretary to the Foundation, after five years of service. Geoff, who came to the WMF from a very senior role at eBay, posted a message to the Wikimedia mailing list expressing his love for "the mission, the Foundation, the Wikimedia communities, and my colleagues at work ... I stand in awe of the volunteer writers, editors, and photographers who contribute every day to the Wikimedia projects. The future of the Foundation under Katherine's leadership is exciting."
Executive director Katherine Maher replied to Geoff:
| You’ve seen the Foundation through a remarkable five years. You’ve built a tremendous team that is critical to helping the Wikimedia projects thrive well into the future. You’ve expertly navigated our challenges, focusing our efforts where we can have the most impact. Through your team, you've empowered the Foundation as fierce advocates for open licensing, privacy, freedom of information, and contributors rights, truly embodying the values of our movement. And as a colleague, you’ve been a counselor and voice of wisdom for our executive team and Board of Trustees. |
Michelle Paulson will be interim head of legal, and Stephen LaPorte will be interim secretary to the Board (pending Board approval). Geoff will take up the position of director of YouTube Trust & Safety, managing global teams for policy, legal, and anti-abuse operations. We wish him well. – T
Brief notes
- New administrators: The Signpost welcomes two new administrators on the English Knowledge (XXG): Jo-Jo Eumerus, and BU Rob13.
No ArbCom prescription needed?
The Arbitration Committee (ArbCom) recently decided to implement a new type of restriction for pages on certain topics with intractable and long-running disputes, such as the Gamergate controversy. It barred editing from anonymous (IP) users and registered editors with fewer than 30 days tenure and 500 edits.
Initially, a series of edit filters enforced the restriction. In January 2016, an editor proposed a new protection level called extended confirmed protection ("ECP" or "30/500", for short) with the same function. Although the proposal received some complaints regarding the instruction creep it presented to new editors, it was eventually approved and technically implemented, with editors being granted the "extendedconfirmed" user right after reaching the requirement. ECP was rolled out on April 5, with ArbCom passing a motion allowing administrators to use ECP to prevent sockpuppetry when less restrictive protection fails to work.
Since that time, ECP occasionally deviated from its ArbCom use: without raising the eyebrows of many, it was used for other reasons, such as to prevent BLP violations. Within three months, an administrator made a proposal allowing use of ECP for any purpose, not just for ArbCom and sockpuppetry: that, with community scrutiny, administrators would be allowed to use ECP protection. The RfC gave editors three options:
- To restrict use of ECP to ArbCom.
- To restrict use of ECP to ArbCom and for preventing sock puppetry when less restrictive protection fails, provided that the protecting administrator informs the community at AN (closest to status quo).
- To allow use of ECP for any purpose, provided that less restrictive protection fails and the protecting administrator informs the community at AN.
The RfC has received a wide range of inputs, with most non-administrators and administrators supporting the third option, and some non-administrators and a few administrators supporting the first and second options. Proponents of the third option believe ECP would be valuable in stopping disruption, while its opponents believe that it would deter newcomers and disenfranchise occasional editors.
More GMO discussion: recently closed RfC on genetically modified food safety
Genetically modified organisms (GMOs) have been a controversial topic for years on Knowledge (XXG), and one with a less than peaceful environment: a number of editors have been sanctioned by ArbCom for poor decorum in GMO discussion, and "discretionary sanctions" have been implemented to stabilize GMO articles.
Knowledge (XXG)'s coverage of the safety of GM foods in particular has been a source of conflict. Many editors believed the then-current wording on GMO safety was inadequate and provides little context:
There is a general scientific agreement that food from genetically modified crops is not inherently riskier to human health than conventional food, but should be tested on a case-by-case basis. No reports of ill effects have been proven in the human population from ingesting GM food. Although labeling of GMO products in the marketplace is required in many countries, it is not required in the United States and no distinction between marketed GMO and non-GMO foods is recognized by the US FDA. In a May 2014 article in The Economist it was argued that, while GM foods could potentially help feed 842 million malnourished people globally, laws such as those being considered by Vermont's governor, Peter Shumlin, to require labeling of foods containing genetically modified ingredients, could have the unintended consequence of interrupting the process of spreading GM technologies to impoverished countries that suffer with food security problems.
— Pre-RfC version of second paragraph of Genetically modified organism#Controversy.
To help settle the question, a RfC to change the current wording was opened. Moderated under tight conditions, with strict word limits and behavioral restrictions, there were 22 proposals; nearly 90 editors participated. After one month of discussion, the RfC was closed on July 7, and the first proposal prevailed:
There is a scientific consensus that currently available food derived from GM crops poses no greater risk to human health than conventional food, but that each GM food needs to be tested on a case-by-case basis before introduction. Nonetheless, members of the public are much less likely than scientists to perceive GM foods as safe. The legal and regulatory status of GM foods varies by country, with some nations banning or restricting them, and others permitting them with widely differing degrees of regulation.
— Proposal 1, Knowledge (XXG):Requests for comment/Genetically modified organisms
GMO articles faced a less-than-smooth transition afterwards, as several editors debated the best way to include the new language and replace the old. In the first few days after the RfC was closed, additional text was deleted and replaced while some editors debated whether to change language immediately before and after the RfC-mandated language. Approximately a week later, those disagreements had calmed down.
In brief
- COI and outing: Largely fueled by the recent block of Jytdog for outing, an RfC has been opened on whether linking the accounts of paid editors to their profiles on other websites (such as Elance) is acceptable. Supporters of this exemption believe that it would help identify paid editors, while opposers contend that harassment and outing is unacceptable in all cases.
- Finally: For the last year and a half, RfB was the forgotten process. However, prolific Bot Approvals Group member Xaosflux decided to run this month, and, with zero opposition, promoted to the elite coterie of bureaucrats.
- New administrators: The Signpost welcomes our two new administrators: Jo-Jo Eumerus and BU Rob13.
- An RfC proposing a new user group called "moderator" has been opened after an unsuccessful RfC in 2013. If enacted, it would be given via an RfA-like process and include full deletion rights and some other tools from the administrator toolkit.
- Busy week after the 2016 Nice attack: After a terrorist drove a truck into crowds celebrating Bastille Day in Nice, France, killing 84 people, many Wikipedians edited and disputed various aspects of the article, including the name of the article, certain details of the attack (e.g., whether it was Islamic terrorism or not), and the notability of the assailant.
Women-in-science editathon gets national press; Knowledge (XXG) "shockingly biased"
Editathon on female scientists in India
]
The Hindu reported about an edit-a-thon on Indian women scientists held on July 16 in Bangalore. Their pre-event article noted that only about 40 women scientists from the country currently have Knowledge (XXG) entries, and many of those are incomplete or lack citations.
The paper's followup article reported that about 25 editors participated in the event, creating and updating articles on prominent women scientists in the country. Sandhya Srikant Visweswariah, chair of the Department of Molecular Reproduction, Development and Genetics at the Indian Institute of Science, was among the subjects tackled. One participant noted, however, that "lack of citations online made it hard to validate entries for many women scientists from the country". This, of course, is a persistent concern, as discussed in part in The Atlantic last month. Having content online leads to the production of more content. Creating new material from non-online content – and being able to use that content to defend Knowledge (XXG)'s processes of validating content and assessing notability – is a much bigger task although also an essential one.--Milo
- Increasing visibility of Indian women in science, The Hindu (July 12)
- Spotlight on women scientists, The Hindu (July 17)
- Demand to better wiki pages for women scientists, The New Indian Express (July 18)
- Knowledge (XXG):Indian Women in Science Edit-a-thon
Cracked.com featured a critical piece on Knowledge (XXG) as "shockingly biased", with input from current administrator Crisco 1492. The piece falls squarely in the sweet-spot of modern criticism of any website: (1) it comes from a website that loves Knowledge (XXG); (2) has readers who love Knowledge (XXG) and use it all the time despite its faults; and thus (3) will read any articles, which raises "shocking" concerns about Knowledge (XXG). And though the items discussed are mostly old-hat to Knowledge (XXG) editors (not to discount their importance), such articles are usually popular. This one has already received over 350,000 views and 450 comments.
The topic areas discussed in the article include three common complaints: (1) the lack of diversity in contributors and content, such as the gender gap and systemic biases (see The Hindu edit-a-thon discussed above), and the focus of some editors on niche content areas; (2) the ever-present problem of vandalism, but particularly the feedback loop where inaccuracies are cited in the press – "like a game of telephone, only at the end of the game, the garbled nonsense gets published in a newspaper"; and (3) petty arguments among editors, though this discussion also ends in more discussion of vandalism, such as those quixotic editors who like to change heights and weights.
The article also cites the Wikipediocracy website as one "dedicated to destroying Knowledge (XXG)", though such a threat does not seem as existential when described as "less like a public service and more like a bunch of Mensa wannabes trying to high five, only to awkwardly smack each other in the nose". Lastly, the piece concludes that "Knowledge (XXG) is dying", citing statistics about declining numbers of "very active" editors and the lack of sufficient administrators.
All of these concerns have degrees of validity, and though not precisely news, the continuing focus on them is no doubt important in finding solutions. When high-profile articles stop being written about Knowledge (XXG)'s flaws, that would suggest irrelevance, which is a much surer sign of decline. No one complains about the functionality or value of Myspace anymore.--Milo
In brief
- New notification features: The Knowledge (XXG) blog detailed the newly released updates to the notification system. Highlights include being able to monitor notifications across all wikis on which an editor is active, options to filter your notifications, and bundling of notifications ("5 people thanking you for your edit"), among other updates (July 15)--Milo
- Apology for misuse of photo on Commons: The use of a Creative Commons licensed photo on an Italian festival poster, without proper attribution, led to a settlement with payment of legal fees when the photographer decided to stand up against the misuse of the photograph, as reported in the Wikimedia blog and elsewhere. Teaching the Internet that a "free license" is not "public domain" is not an easy task. (July 12)--Milo
- Ten Years on Knowledge (XXG): William Beutler (User:WWB) celebrated ten years on Knowledge (XXG) with a post compiling some of the life lessons he has learned from his time on the site. (July 12)--Milo
- Maybe They Got the Munchies: The Daily Mail and many Australian news outlets like Byron News report that Senator-Elect Pauline Hanson's party policy on medical marijuana appeared to be lifted from Knowledge (XXG). The unattributed copying was first noted on Reddit. (July 10–12)--Milo
- I Wonder What That Is: HERE announced that its app now has a "Knowledge (XXG) Sights" feature which can display geolocated links to articles of interest in your vicinity. (July 8)--Milo
- IP removing unfavorable content geolocates close to home base: The Knowledge (XXG) biography of UK MP Andrea Leadsom (pictured above with Theresa May) drew the attention of The Guardian, when unfavorable content about the energy minister and contender for Prime Minister was removed from her Knowledge (XXG) article by an anonymous IP address that geolocated to Towcester, where her constituency office is located. (July 6)--MTbw
- Knowledge (XXG)'s seven worst moments?: A Breitbart op-ed produced a "worst moments" list ranging from the removal of the 2016 Orlando nightclub shooting from list of Islamist terrorist attacks (though it has reappeared on the list subsequent to the Breitbart article) to a description of the GamerGate article as "one of the most biased pages on Knowledge (XXG)". Breitbart describes Knowledge (XXG) as "... frequently embroiled in controversy surrounding political biases, corrupt mismanagement, and attempts to secretly remove factual information contrary to their narrative". (July 5)--MTbw
- Copypasting a Knowledge (XXG) bio for a campaign handout called a "brain freeze": When Hillary Clinton spoke at Jesse Jackson's Rainbow/PUSH Coalition in Chicago, a glossy program given to attendees was copypasted directly from Knowledge (XXG)—including mentions of assorted past controversies that generally are absent from a laudatory blurb provided at a campaign event. Organizers stated, "a volunteer had a real brain freeze" when curating the content of the program and humbly explained that the inclusion of references to the Monica Lewinsky scandal was unintentional. (June 28) --MTbw
A wide variety from the best
Text may be adapted from the respective articles and lists; see their page histories for attribution.
Featured articles
Seven featured articles were promoted these weeks.
- Dr. No (nominated by SchroCat) is the sixth novel by the English author Ian Fleming to feature his British Secret Service agent James Bond. Fleming wrote the novel in early 1957 at his Goldeneye estate in Jamaica. It was first published in the United Kingdom by Jonathan Cape on 31 March 1958. The novel centres on Bond's investigation into the disappearance in Jamaica of two fellow MI6 operatives. He establishes that they had been investigating Doctor No, a Chinese operator of a guano mine on the fictional Caribbean island of Crab Key. Bond travels to the island and meets Honeychile Rider and later Doctor No. The story was adapted in 1962 as the first film in the Bond series, with Sean Connery in the lead role.
- The impala (nominated by Sainsf) (Aepyceros melampus) is a medium-sized antelope in eastern and southern Africa. The sole member of the genus Aepyceros, it was first described by German zoologist Martin Hinrich Carl Lichtenstein in 1812. Two subspecies are recognised, the common impala, and the black-faced impala. The impala reaches 70–92 centimetres (28–36 in) at the shoulder and weighs 40–76 kilograms (88–168 lb). It features a glossy, reddish-brown coat. The male's slender, lyre-shaped horns are 45–92 centimetres (18–36 in) long.
- Old Pine Church (nominated by West Virginian) is a mid-19th century church near Purgitsville, West Virginia. It is among the earliest extant log churches in Hampshire County. The church is a large, one-story, gablefront log building sheathed in brown-painted wooden German siding. The original hewn log beams are visible beneath the church, with some bark remaining on the logs. The church's interior ceiling measures approximately 15 feet (4.6 m) in height and is clad in pressed metal panels. In the church's adjoining cemetery, the earliest extant gravestone dates from 1834, and several unmarked interment sites may exist from as early as 1759. It was added to the National Register of Historic Places in 2012, due to its "significant settlement-era rural religious architecture in the Potomac Highlands".
- Agharta (nominated by Dan56) is a 1975 live double album by American jazz musician Miles Davis. After experimenting with different lineups, he established a stable live band in 1973 and toured constantly for the next two years. During a three-week tour of Japan in 1975, Davis performed two concerts at the Festival Hall in Osaka; the afternoon show produced Agharta and the evening show was released as Pangaea the following year.
- The CMLL World Light Heavyweight Championship (nominated by MPJ-DK) is a professional wrestling world heavyweight championship promoted by Consejo Mundial de Lucha Libre. As it is a professional wrestling championship, it is not won via legitimate competition; it is instead won via a scripted ending to a match or on occasion awarded to a wrestler because of a storyline. The official definition of the light heavyweight division in Mexico is between 92 and 97 kilograms (203 and 214 lb), but the weight limits are not always strictly adhered to. Because CMLL puts more emphasis on the lower weight classes, this division is considered more important than the heavyweight division, which is considered the most important championship by most promotions outside of Mexico. The current champion is La Máscara, who is in his first reign.
- "The Man Trap" (nominated by Miyagawa) is the first episode of the American science fiction television series Star Trek. It aired on NBC in 1966. Set in the 23rd century, the series follows the adventures of Captain James T. Kirk and his crew aboard the Starfleet starship USS Enterprise. In this episode, the crew visit an outpost to conduct medical exams on the residents, only to be attacked by a shapeshifting alien creature seeking to extract salt from their bodies. "The Man Trap" was written by George Clayton Johnson and directed by Marc Daniels. The episode placed first in the timeslot with a Nielsen rating of 25.2 percent for the first half-hour and 24.2 for the remainder. After broadcast, reviewers criticized the levels of violence but praised the acting. More recent appraisals have been mixed; praise has been given to the plot and diverse cast but Hollywood.com listed it as among the worst episodes of the series.
- Milos Raonic (nominated by Saskoiler) (born 1990) is a Canadian professional tennis player. Raonic is the most successful Canadian singles player in history. He became the highest-ranked Canadian male tennis player ever in 2011, when he reached world No. 37. His career-high world No. 4 ranking is the highest by a Canadian man or woman. He is the first Canadian man in the Open Era to reach the Australian Open semifinals, the French Open quarterfinals, and the Wimbledon final. He has more ATP World Tour titles and finals appearances in the Open Era than all other Canadian men combined.
Featured lists
Five featured lists were promoted these weeks.
- Sri Lanka's electricity demand is currently met by nine thermal power stations, fifteen large hydroelectric power stations, and fifteen wind farms (nominated by Rehman), with a smaller share from small hydro facilities and other renewables such as solar. Most hydroelectric and thermal/fossil fuel based power stations in the country are owned and/or operated by the government via the state-run Ceylon Electricity Board, while the renewable energy sector consists mostly of privately run plants operating with a power purchase agreement.
- Following the trial of Charles I in 1649, 59 commissioners signed his death warrant. They, along with the several key associates and numerous court officials, were the subject of punishment following the restoration of the monarchy in 1660 with the coronation of Charles II. Charles I's trial and execution had followed the English Civil War (1642–51) in which his supporters, Royalist "Cavaliers", were opposed by the Parliamentarian "Roundheads", led by Oliver Cromwell. There is no agreed definition of who is included in the list of regicides (nominated by SchroCat). The Indemnity and Oblivion Act did not use the term either as a definition of the act, or as a label for those involved. "Regicide" has never been specific crime in English law, and has never been defined in law. Historians have identified different groups of people as being suitable for the name, and some do not include the associates who also faced trial and punishment.
- The Rajiv Gandhi Khel Ratna (nominated by Vivvt) is the highest sporting honour of India. The award is named after Rajiv Gandhi, former Prime Minister of India who served the office from 1984 to 1989. It is awarded annually by the Ministry of Youth Affairs and Sports. The recipients are selected by a committee constituted by the Ministry and is honoured for their "spectacular and most outstanding performance in the field of sports over a period of four years" at international level. As of 2016, the award comprises a medallion, a certificate, and a cash prize of ₹7.5 lakh (US$9,000). As of 2015, there have been twenty-eight recipients from twelve sport disciplines.
- The Latin Grammy Lifetime Achievement Award (nominated by Magiciandude) is an honor presented annually by the Latin Academy of Recording Arts & Sciences, the same organization that distributes the Latin Grammy Awards, to commend musicians who have made creative contributions of outstanding artistic significance to the field of recording. Award recipients are honored during "Latin Grammy Week", a string of galas just prior to the annual Latin Grammy Awards ceremony.
- Matt Damon (born 1970) is an American actor, producer and screenwriter. His filmography (nominated by Krimuk90) includes 72 films (including three television movies) and twelve television episodes. With box office receipts of over $2.9 billion in North America, Damon ranks among Hollywood's most commercially successful actors. Damon has featured as a guest star in the television shows Will & Grace (2002), Entourage (2009) and 30 Rock (2010–11), among others. A production company he formed in 2000 with Ben Affleck and Sean Bailey, named LivePlanet, produced Project Greenlight (2001–05, 2015), a television series that helps newcomers develop their first film. Damon has served as the executive producer of a number of projects directed by the winners of the show. In addition, he has narrated several documentaries, including The People Speak (2009) and Inside Job (2010).
Featured topics
One featured topic was promoted these weeks.
- U.S. Highways in Michigan (nominated by Imzadi1979) are the segments of the national United States Numbered Highway System that are owned and maintained by the US state of Michigan, totaling about 2,300 miles (3,701 km). The longest of these is US Highway 23 at around 362 miles (583 km). On a national level, the standards and numbering for the system are handled by the American Association of State Highway and Transportation Officials, while the highways in Michigan are maintained by the Michigan Department of Transportation.
Featured pictures
Fourteen featured pictures were promoted these weeks.
-
-
-
-
-
-
-
-
-
-
-
-
-
Alice Catherine Evans
(created by the National Photo Company; restored and nominated by Adam Cuerden) -
Sports and esports
Your Traffic Reports for the weeks of June 26 – July 2, and July 3–9, 2016:
The dominant topic in Knowledge (XXG) traffic the week of June 26 to July 2 was sports, and more particularly football, with UEFA Euro 2016 in the top spot for third straight week. And Iceland's improbable team (#22 in the WP:TOP25) victory over England in UEFA Euro 2016 put that country's article at #5. Lionel Messi's (#4) defeat at the Copa América (#12) final, and his subsequent retirement announcement, was also big news. In other news, the hangover from Brexit (#25) kept the European Union (#9) in the top ten for a second week, and put Boris Johnson (#13) and Theresa May (#17) on the Top 25 as well. Game of Thrones also merits a mention, taking slots #2 and #3, and its season finale episode article at #18.
Moving on to the week of July 3–9, sports dominated again this week, with the traditional return of Wimbledon joining the lead-up to the UEFA Euro 2016 football tournament, the latest UFC event, and an unexpected team change for an NBA superstar. But it was a sport of an entirely modern kind, Pokemon Go, that led the pack, and before you ask, yes, Pokemon is an esport. Traditional summer distractions such as movies and television round out the list, with the inclusion of politicians Donald Trump and Andrea Leadsom after the Top 10 to remind us (barely) of the real world.
For the full top-25 lists (and our archives back to January 2013), see WP:TOP25. See this section for an explanation of any exclusions. For a list of the most edited articles every week, see WP:MOSTEDITED. For the most popular articles that ORES models predict are low quality, see WP:POPULARLOWQUALITY.
June 26 – July 2
The ten most popular articles on Knowledge (XXG), as determined from the WP:5000 were:
Rank Article Class Views Image Notes 1 UEFA Euro 2016 
1,590,000 
A third straight week in the top spot, though with less than half as many views as last week. The Round of 16 commenced on June 25, and the quarter-final rounds were underway when this weeks' report closed July 2. The final four teams were Portugal, Wales(!), Germany, and France, with the next match on July 6. 2 Game of Thrones 
1,126,688 
Last week the Season 6 article was #6, while this general series article was #16 (with 730K views). Why the switch this week? No doubt it is because the season finale on June 26 (The Winds of Winter) (#18) caused more mainstream press coverage, prompting more people unfamiliar with the show to look it up on Knowledge (XXG) to see what they were missing. 3 Game of Thrones (season 6)
1,103,448 See #2. Numbers up slightly from last week. 4 Lionel Messi 
1,060,930 
Up from #21 and 564K views last week. The Argentine forward and "best footballer on the planet" faced Chile in the Copa America Centenario final on June 26, and lost on penalty kicks after a 0–0 draw. The 29-year-old Messi announced his retirement after the game. 5 Iceland
784,708 
Views spiked on the northern island country's article on June 27 and 28. On June 27, Iceland defeated England 2–1 in their UEFA Euro 2016 Round of 16 match. But alas, Iceland fell to France on July 3 and did not make the semi-finals. 6 Pat Summitt
764,584 
The longtime head coach of the Tennessee Lady Volunteers basketball team, who won a record 1,098 games in her tenure, died at age 64. She retired from coaching in 2012 after being diagnosed with early-onset Alzheimer's disease. Her public openness about her condition was widely admired and helped raise awareness of the disease and its impact. 7 Battle of the Somme
757,121 
The 100th anniversary of the commencement of this First World War battle fell on July 1. The battle was intended to hasten a victory for the Allies and was the largest battle of the First World War on the Western Front. More than one million men were wounded or killed, making it one of the bloodiest battles in history. 8 Independence Day: Resurgence
755,170 
The 20-years-later sequel to Independence Day premiered in the United States on June 24. As of July 4, its worldwide gross is $252 million; the film had a budget of $165 million. It has received mostly negative reviews, though I fully intend to see it. Down slightly from 810K views last week. 9 European Union
736,104 
Views previously spiked on June 24 due to the Brexit vote, but traffic remained high (though declining each day) for this entire week as the aftermath of the vote began to be digested. Down from #3 and 1.97 million views last week. 10 Jesse Williams (actor) 
720,299 
At the BET Awards on June 26, this actor won a humanitarian award, and delivered a speech highlighting racial injustice, police brutality, and cultural appropriation, which drew press attention far beyond anything the BET Awards normally gets. (BET is an acronym for Black Entertainment Television, the most prominent television network targeting African American audiences.)
- Just missing the WP:TOP25: Nigel Farage (#26, 448,792); Mel Brooks (#27, 446,896); Gianluigi Buffon (#28, 435,474); Copa América Centenario (#29, 427,565); Zlatan Ibrahimović (#30, 412,919)
July 3–9
The ten most popular articles on Knowledge (XXG), as determined from the WP:5000 were:
Rank Article Class Views Image Notes 1 Pokémon Go
1,371,390 
For most people born before the Clinton administration, Pokémon is about as comprehensible as the religious customs of some lost Pacific island or the codes and shibboleths of an ancient secret society. Which, by the way, is exactly why your kids love it so much. It's too complicated to explain quickly but the latest iteration exploded into the public mind almost overnight (it currently has more users than Tinder in the US, despite only being in release for 5 days) due to its unique, and perhaps uniquely dangerous, gameplay. Thanks to the wonders of augmented reality, Google Maps and GPS, a real-time scavenger hunt has morphed with a video game; it's everywhere you go. Hold up your iPhone to a tree, there's a Pokémon sitting in a crook, waiting to be captured and sent to the death ring, er, I mean "gym". Look down on the pavement, and there's a cute Pokémon staring up at you. And hey look! There's one swimming in that deceptively close and surprisingly deep pond! And there's one across that very busy street! Yes, Pokemon Go-related accidents have already happened, as have muggings, since the game alerts any other players to your current location. Thankfully none of this has proven fatal, though it's only a matter of time before a health official is forced to remind the general public that real people do not get extra lives. 2 Sultan (2016 film)
1,152,393 
One big difference between Hollywood and Bollywood is that in Bollywood, stars still matter. And Salman Khan (pictured) rules the roost right now. His last big film, Bajrangi Bhaijaan, dominated Eid al-Fitr weekend and went on to make nearly $100 million. And now he's done it again. His latest, a wrestling drama, was also released on Eid and has taken in nearly ₹1.96 billion ($29 million) in its first six days. 3 Independence Day (United States)
1,142,261 
This is the fourth US Independence Day since we started this list, which means it's time to look for patterns, and one that stands out is that while this article's numbers keep climbing year upon year, it has never been the #1 article for its week. Some have speculated that Americans already know enough about their founding holiday and don't need to look it up. 4 UEFA Euro 2016
988,687 Numbers are down slightly for the quarter- and semi-finals, which saw the darlings of the tournament (Wales and Iceland) predictably knocked out by France and Portugal. This list's timeframe ends before the 10 July final so expect numbers to shoot up again next week. 5 Juno (spacecraft)
960,161 
Not all NASA missions need to be glamorous; this one, which began a slow, winding descent towards Jupiter on 4 July, won't be gracing us with grand vistas of the jewels of the Jovian realm. No: this one is hardcore, pick-to-the-cliff science. Have you ever seen a cutaway image of the inside of a gas giant? Well if not, here's one. Thing is, up until now, it's basically educated guesswork. We don't have any hard evidence of what's under those clouds. But we will, thanks to Juno, which will get the info by mapping Jupiter's gravitational field. But to do so, it has to get close. Real close. As in, close enough to be fried by Jupiter's 12,000-Chernobyls-per-second radiation belts. Needless to say, it's a tough little bugger, but its creators don't expect it to be producing useful science for more than 18 months before it's toast. 6 Nettie Stevens
896,719 
This pioneering geneticist and discoverer of the XY sex-determination system got a Google Doodle on her 155th birthday on 7 July. 7 UFC 200
872,178 
The latest in the mixed martial arts tournament series was held at the T-Mobile Arena in Las Vegas (pictured) on 9 July. Headliner Amanda Nunes defeated Miesha Tate in the first round. 8 Serena Williams
857,452 
The world women's number 1 tennis champion clinched yet another record on 9 July when she beat Angelique Kerber in straight sets to clinch her 22nd major singles title at her natural home, Wimbledon. Two more titles and she will equal Margaret Court's career record. 9 Antoine Griezmann
849,627 
Olivier Giroud may have scored two goals for France in the Euro 2016 semi-final, but it was Griezmann who scored the most goals in the tournament. 10 Kevin Durant
707,764 
The seven-time NBA All-Star signed with the Western Conference champion Golden State Warriors this week for a reported two-year, $54 million contract.
On 10 June, arbitrator clerk L235 posted an announcement that the clerks were looking for script writers who "will work with the clerk team to automate portions of the clerks' procedures." These procedures include, but are not limited to, vetting new requests, opening and managing open cases and miscellaneous tasks such as arbitrator retirements. On 7 July, L235 announced that Fred Gandt and Σ would be appointed as the script developers. Best of luck to both on future outings.
If any editor is interested in assisting, you can contact the clerks at .
- In Brief
- Mdann52 appointed to full clerk: on 14 June, Mdann52, formerly a trainee clerk, was promoted to full clerk status. Mdann52 is one of nine currently active editors who are arbitration clerks.
- Malik Shabazz: In August 2015, the administrator privileges of Malik Shabazz were temporarily removed under the Level I desysop procedure. On 9 July, in a 10–0 decision by the committee, they felt they were satisfied that the account was not compromised and the disruption had ceased. Malik Shabazz may request to be resysopped at any time.
- Arbitration Committee motion amending the Rich Farmbrough arbitration case: On 9 July, a motion was made by the committee in the Rich Farmbrough case to rescind sanctions to prohibit Rich Farmbrough from using automation and clause B in the June 2012 amendment.
Using deep learning to predict article quality; search engine helps schoolkids navigate Chinese Knowledge (XXG); talk page sentiment
A monthly overview of recent academic research about Knowledge (XXG) and other Wikimedia projects, also published as the Wikimedia Research Newsletter.
Using deep learning to predict article quality
- Reviewed by Morten Warncke-Wang
A short paper presented at the Joint Conference on Digital Libraries titled "Quality Assessment of Knowledge (XXG) Articles Without Feature Engineering" uses deep learning to predict the quality of articles in the English Knowledge (XXG). As the paper's title alludes, previous research on article quality has used a specific set of features to represent the articles, whereas the promise of deep learning is that the machine learner will determine the best representation on its own.
Some representation of the articles still requires to be chosen, and the paper uses "Doc2Vec", an extension of Word2vec that uses unsupervised machine learning to learn vector representations of the articles. A benefit of this approach is that it is language neutral, whereas other approaches might utilize features that are language-specific. These vectors are learned from a training set based on the Wikimedia Foundation's dataset of 30,000 English articles. A deep neural network using Google’s TensorFlow library is then trained using these vectors with the aim to predict to which of the English Knowledge (XXG)’s assessment classes an article belongs.
The performance of the classifier is compared to the current state of the art, which at the time of writing is the WMF's own Objective Revision Evaluation Service (ORES) (disclaimer: the reviewer is the primary author of the research upon which ORES' article quality classifier is built). Since the number of articles in each class is fairly balanced, the proportion of correctly classified instances (accuracy) is used as the performance measure. ORES is reported to be 60% accurate (it currently reports 61.9% accuracy), and the deep neural network was found to be 55% accurate. As pointed out in the paper, this work is a first step towards using deep learning for this task, meaning that slightly lower performance is acceptable. The authors describe a couple of changes that will most likely improve the classifier and aim to do so in future work. Deep learning is an area where interesting things are happening, and if it can be used to improve our ability to automatically assess Knowledge (XXG) articles, a service that is already useful to many Wikipedians through services like WikiProject X and SuggestBot, that is only for the better!
Taiwanese researchers develop tool using Chinese Knowledge (XXG) to help primary and secondary schoolchildren
Dr. Tsung-Ho Liang (梁宗賀) is a systems analyst in the information center at the Tainan City Government's Bureau of Education. He currently studies big data in education, especially dealing with unstructured data and natural language processing techniques. In 2013, he started a project to integrate the contents of Chinese Knowledge (XXG) with the Chinese Knowledge and Information Processing (CKIP) technology and established a new search engine for Chinese Knowledge (XXG), – WikiSeeker (維基嬉客).
WikiSeeker is a tailor-made search system based on the Knowledge (XXG) corpus to leverage search effectiveness by providing structured association graphs with related Knowledge (XXG) articles for students' queries in Chinese. First, it produces a knowledge map with clear relationships among each field of knowledge, so students can easily identify the most important keywords among contents. Second, the search bar of WikiSeeker is capable of using natural language to search instead of typing keywords. You can see a tour of WikiSeeker on Youtube.
The above two features make WikiSeeker intuitive and easy to use for K-12 students. According to the research essay "WikiSeeker─The Study of the Impact of a Search System with Structured Association Graphs on Learning Effectiveness" by the researcher Sheng-Nan Cheng (鄭盛南), two experimental groups were adopted in this study: one asks students to use Chinese Knowledge (XXG) directly to answer questions, and another asks students use the WikiSeeker website to answer the same questions. The results showed that the students who used WikiSeeker were 10.8% more correct in their answers (on average, 13.73 out of 19, compared to 15.8 out of 19 questions). Moreover, it was found that girls and middle-achieving students reached the highest learning improvement when using WikiSeeker. The conclusion suggests that WikiSeeker is suitable for students to acquire knowledge in Chinese Knowledge (XXG).
Sentiment analysis applied to adminship votes and talk page comments
- Reviewed by Tilman Bayer
Sentiment analysis - the automated extraction of subjective information expressed in text - has been applied to Knowledge (XXG) research in several recent papers.
Four researchers from Stanford University analyzed all (non-neutral) votes in the English Knowledge (XXG)'s request for adminship process cast from its inception in 2003 until 2013. These form a directed, signed graph with around 11,000 nodes (users) and 160,000 edges (votes). They removed the actual vote text ("support" and "oppose") and tried to reconstruct the vote by applying sentiment analysis to the remaining comment text (where e.g. "I’ve no concerns, will make an excellent addition to the admin corps" indicates a positive vote). The performance of the resulting prediction model is described as "remarkably high, as a consequence of the highly indicative, sometimes even formulaic, language used in the comments". It performed much better than a model trying to predict votes based on network characteristics alone (patterns of other support/oppose votes, using e.g. ideas from balance theory like "an enemy of my enemy is my friend").
Is the editing frequency of Wikipedians influenced by negative or positive comments they receive on their user talk pages?
A student course project at the same university tried to examine this question by analyzing the user talk pages of all users (around 620,000) who signed up in 2013 and made at least one article edit on the English Knowledge (XXG), together with "thanks" messages received via the new software feature introduced during that year. They related this data to the number of article edits per week. The authors report that "while we found some predictive value for future behavior in the sentimental content of messages received by Knowledge (XXG) editors, we do not have evidence to establish a causal relationship between these variables... we were able to detect macro-level patterns of behavior that appear to discredit the hypothesis that the sentimental content of user talk pages is a main driver of user churn on Knowledge (XXG)". As a limitation of their application of sentiment analysis in this situation, they note that "Most messages exchanged through user talk pages are not sentimentally-loaded, but rather talk about the Knowledge (XXG) guidelines and policies in a neutral manner", calling for the use of more sophisticated natural language processing techniques.
These results are somewhat in contrast to those of a paper titled "The Impact of Sentiment-driven Feedback on Knowledge Reuse in Online Communities", which investigated "whether affective communication in form of sentiment-driven feedback in discussions between Knowledge (XXG) editors motivates collaborative work", by analyzing a complete history dump of the Simple English Knowledge (XXG) (until 2011). The researchers focus on the "knowledge reuse" aspect of this collaborative work, quantified for "any two consecutive revisions of the same article page as the ratio of the number of words reused from the previous revision (e.g., copied, moved elsewhere, or restored) to the number of words newly created in the current revision." By relating the positivity or negativity of article talk page comments to editing activity in the article itself, the authors found that:
- "receiving (especially positive, rather than negative) feedback in form of sentiments that are expressed in inter-editor conversations is beneficial in terms of sustaining knowledge reuse in Knowledge (XXG); moreover, giving either positive or negative feedback appears to be more effective than providing no feedback at all."
Besides observing that public positive feedback may have a positive effect on editor motivation, they also note that "non-public negative peer feedback could increase one’s likelihood to engage in online social production by correcting inherent problems, behaviors, and attitudes in private peer conversations, which also strongly suggests that mechanisms for providing non-public negative feedback should be designed, incorporated, and tested in collaborative platforms such as wikis."
See also our earlier coverage of sentiment analysis research, and a current research collaboration of the Wikimedia Foundation and other researchers that aims "to use machine learning and statistics to understand how attacking or 'toxic' language affects the contributor community on Knowledge (XXG). The focus of our analysis is initially on talk page comments that exhibit harassment, personal attacks and aggressive tone."
Briefly
Conferences and events
Wikimania 2016, the annual global Wikimedia conference, took place in June in Esino Lario, Italy. The programme contained various research-related session, including the annual "State of Wikimedia Research" presentation highlighting some of the most interesting scholarship from the past year (slides).
See the research events page on Meta-wiki for upcoming conferences and events, including submission deadlines.
Other recent publications
A list of other recent publications that could not be covered in time for this issue – contributions are always welcome for reviewing or summarizing newly published research.
- "50/50 Norm in Massive Online Public Good: The Case of Knowledge (XXG)" From the abstract: "This paper shows the existence of a strong social norm in , demonstrated by the choice of the equal split in the Dictator Game (DG). With the help of the French Wikimédia Foundation , we questioned a large sample of Knowledge (XXG) users and contributors on their practices, and then asked them to play the DG. The results are statistically significant and show how people respect (or not) social norms. Regular, long-term users, who declare a strong attachment to the platform, are more likely to choose the 50/50 split in the DG."
- "Dynamics of Disagreement: Large-Scale Temporal Network Analysis Reveals Negative Interactions in Online Collaboration" From the abstract: "We analyze sequences of reverts of contributions to Knowledge (XXG) . We find evidence that individuals systematically attack the same person and attack back their attacker . We also establish that individuals come to defend an attack victim but we do not find evidence that attack victims 'pay it forward' or that attackers collude to attack the same individual. We further find that high-status contributors are more likely to attack many others serially, status equals are more likely to revenge attacks back, while attacks by lower-status contributors trigger attacks forward; yet, it is the lower-status contributors who also come forward to defend third parties."
- "Knowledge (XXG): Access and participation in an open encyclopaedia" From the abstract: "This thesis found participation is shaped by different understandings of openness, where it is constructed as either a libertarian ideal where 'anyone' is free to edit the encyclopaedia, or as an inclusive concept that enables 'everyone' to participate in the platform. The findings therefore problematise the idea of single user community, and serve to highlight the different and sometimes competing approaches actors employ to enable and constrain participation in Knowledge (XXG)."
- "Cultural Anthropology through the Lens of Knowledge (XXG): Historical Leader Networks, Gender Bias, and News-based Sentiment" From the abstract: "we study the differences in historical World View between Western and Eastern cultures, represented through the English, the Chinese, Japanese, and German Knowledge (XXG). In particular, we analyze the historical networks of the World's leaders since the beginning of written history . We also identify the most influential female leaders of all times in the English, German ( both Elizabeth II ), Spanish ( Michelle Bachelet ), and Portuguese ( Maria II of Portugal ) Knowledge (XXG). As an additional lens into the soul of a culture we compare top terms, sentiment, emotionality, and complexity of the English, Portuguese, Spanish, and German Wikinews." (cf. earlier coverage of a related paper coauthored by some of the same authors: "Most important people of all times, according to four Wikipedias")
- "Prediction of influenza outbreaks by integrating Knowledge (XXG) article access logs and Google flu trend data"
- "Is There a Weekly Pattern for Health Searches on Knowledge (XXG) and Is the Pattern Unique to Health Topics?"(TL;DR: Yes/No)
- "Automatic linking of wikipedia pages by their semantic similarity" From the abstract: "In this study, by using the Natural Language Processing techniques, the linking system ] has been tried to be automatized. Initially, the approach has been designed for Turkish Knowledge (XXG), then in the second step, it has been tried for English Knowledge (XXG) and the results have been compared, evaluations are promising." (cf. m:Research:Improving_link_coverage)
- "Studying the Role of Diversity in Open Collaboration Network: Experiments on Knowledge (XXG)" From the abstract: "We introduce a concept of diversity of interests or versatility of a Knowledge (XXG) editor and Knowledge (XXG) teams and examine how it is correlated with the quality of their production. Our experiments indicate that editor’s and team’s diversity seems to have bigger impact on quality of their work than other properties."
Other student project writeups from the fall 2015 CS229 course at Stanford (see also above):
- "Relevance Analyses and Automatic Categorization of Knowledge (XXG) Articles" From the abstract: "Given a set of article pairs, we found a linear correlation between similarity index outputted from algorithm and human’s ratings on similarity. We then applied hierarchical clustering on a group of articles based on their similarity indices and construct a categorization binary tree. We evaluated the tree by asking humans to play odd-one-out games – given an instance of a triplet of articles, choosing one article that is the most different, and we found that the tree correctly classified approximately 80% of the odd-one-out instance compared to the data from humans."
- "An AI for the Knowledge (XXG) Game"
- "Predicting and Identifying Hypertext in Knowledge (XXG) Articles" (about a machine learning algorithm to decide which words in an article should be "turned blue")
References
- Dang, Quang Vinh; Ignat, Claudia-Lavinia (2016). "Quality Assessment of Knowledge (XXG) Articles Without Feature Engineering". Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries. JCDL '16. New York, NY, USA: ACM. pp. 27–30. doi:10.1145/2910896.2910917. ISBN 9781450342292.
- 鄭盛南 (Sheng-Nan Cheng): 維基嬉客(WikiSeeker) 一個結構化關聯圖之搜尋系統對於學生學習成效之研究 (WikiSeeker─The Study of the Impact of a Search System with Structured Association Graphs on Learning Effectiveness). http://handle.ncl.edu.tw/11296/ndltd/34378100977780630350 Thesis, National University of Tainan 2015 (in Chinese)
- West, Robert; Paskov, Hristo S.; Leskovec, Jure; Potts, Christopher (2014). Exploiting Social Network Structure for Person-to-Person Sentiment Analysis (PDF). Topology, Algebra and Categories in Logic. p. 14. Transactions of the Association for Computational Linguistics, 2 (2014) 297–310. Supplementary proofs and dataset
- Martinez-Ortuno, Sergio; Menghani, Deepak; Roemheld, Lars. Sentiment as a Predictor of Knowledge (XXG) Editor Activity (PDF). Stanford University. p. 4.
- Grigore, Mihai; Rosenkranz, Christoph; Sutanto, Juliana (2015-12-01). "The Impact of Sentiment-driven Feedback on Knowledge Reuse in Online Communities". AIS Transactions on Human-Computer Interaction. 7 (4): 212–232. doi:10.17705/1thci.00073. ISSN 1944-3900.
- Nguyen, Dang; Godefroy; Dejean, Sylvain; Jullien, Nicolas (2016-01-19). 50/50 Norm in Massive Online Public Good: The Case of Knowledge (XXG). Rochester, NY: Social Science Research Network. SSRN 2718040.
- Tsvetkova, Milena; García-Gavilanes, Ruth; Yasseri, Taha (2016-02-04). "Dynamics of Disagreement: Large-Scale Temporal Network Analysis Reveals Negative Interactions in Online Collaboration". Scientific Reports. 6 (6): 36333. arXiv:1602.01652. Bibcode:2016NatSR...636333T. doi:10.1038/srep36333. PMID 27808267. S2CID 4925817.
- Osman, Kim Y. (2015). Knowledge (XXG): Access and participation in an open encyclopaedia (phd). Queensland University of Technology. PhD thesis
- Gloor, Peter A.; Marcos, Joao; de Boer, Patrick M.; Fuehres, Hauke; Lo, Wei; Nemoto, Keiichi (2015). "Cultural Anthropology through the Lens of Knowledge (XXG): Historical Leader Networks, Gender Bias, and News-based Sentiment". arXiv:1508.00055 .
- Bardak, Batuhan; Tan, Mehmet (November 2015). "Prediction of influenza outbreaks by integrating Knowledge (XXG) article access logs and Google flu trend data". 2015 IEEE 15th International Conference on Bioinformatics and Bioengineering (BIBE). 2015 IEEE 15th International Conference on Bioinformatics and Bioengineering (BIBE). pp. 1–6. doi:10.1109/BIBE.2015.7367640.
- Gabarron, Elia; Lau, Annie YS; Wynn, Rolf (2015-12-22). "Is There a Weekly Pattern for Health Searches on Knowledge (XXG) and Is the Pattern Unique to Health Topics?". Journal of Medical Internet Research. 17 (12): e286. doi:10.2196/jmir.5038. ISSN 1438-8871. PMID 26693859.
- Ikikat, F.Y.; Gurhan, B.; Diri, B. (September 2015). "Automatic linking of wikipedia pages by their semantic similarity". 2015 International Symposium on Innovations in Intelligent SysTems and Applications (INISTA). 2015 International Symposium on Innovations in Intelligent SysTems and Applications (INISTA). pp. 1–5. doi:10.1109/INISTA.2015.7276789.
- Baraniak, Katarzyna; Sydow, Marcin; Szejda, Jacek; Czerniawska, Dominika (2016-01-11). "Studying the Role of Diversity in Open Collaboration Network: Experiments on Knowledge (XXG)". In Adam Wierzbicki; Ulrik Brandes; Frank Schweitzer; Dino Pedreschi (eds.). Advances in Network Science. Lecture Notes in Computer Science. Vol. 9564. Springer International Publishing. pp. 97–110. doi:10.1007/978-3-319-28361-6_8. ISBN 978-3-319-28360-9.
- Supaniratisai, George Pakapol; Bhumiwat, Pakapark; Pongsiri, Chayakorn (2015-12-11). Relevance Analyses and Automatic Categorization of Knowledge (XXG) Articles (PDF). Stanford University. p. 5.
- Barron, Alex; Swafford, Zack. An AI for the Knowledge (XXG) Game (PDF). Stanford University. p. 5.
- Guha, Neel; Hu, Annie; Wang, Cindy. Predicting and Identifying Hypertext in Knowledge (XXG) Articles (PDF). Stanford University. p. 6.
- Supplementary references:
- "Dr. Tsung-Ho Liang Curriculum Vitae". Retrieved 2016-07-09.
- "Chinese knowledge and information processing". Retrieved 2016-07-09.