<?xml version="1.0" encoding="UTF-8"?><xml><records><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Michael S. Bernstein</style></author><author><style face="normal" font="default" size="100%">Little, Greg</style></author><author><style face="normal" font="default" size="100%">Miller, Robert C.</style></author><author><style face="normal" font="default" size="100%">Hartmann, Björn</style></author><author><style face="normal" font="default" size="100%">Mark S. Ackerman</style></author><author><style face="normal" font="default" size="100%">David R. Karger</style></author><author><style face="normal" font="default" size="100%">Crowell, David</style></author><author><style face="normal" font="default" size="100%">Panovich, Katrina</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Soylent: A Word Processor with a Crowd Inside</style></title><secondary-title><style face="normal" font="default" size="100%">Commun. ACM</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">crowdsourcing</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2015</style></year></dates><urls><web-urls><url><style face="normal" font="default" size="100%">Complete-OnlyDOI</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">58</style></volume><pages><style face="normal" font="default" size="100%">85–94</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of reliability, cost, wait time, and work time for edits.&lt;/p&gt;</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>47</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Tao Dong</style></author><author><style face="normal" font="default" size="100%">Mark S. Ackerman</style></author><author><style face="normal" font="default" size="100%">Mark W. Newman</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Social Overlays: Collectively Making Websites More Usable</style></title><secondary-title><style face="normal" font="default" size="100%">14th IFIP Conference on Human-Computer Interaction (Interact 2013)</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">crowdsourcing</style></keyword><keyword><style  face="normal" font="default" size="100%">social computing</style></keyword><keyword><style  face="normal" font="default" size="100%">web</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2013</style></year><pub-dates><date><style  face="normal" font="default" size="100%">06/2013</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">Complete</style></url></web-urls></urls><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;Many small organizations lack the expertise and resources to conduct usability evaluations of their websites. Social Overlays, presented here, is a new system that allows a community of users to collectively improve their website. Social Overlays enables end–users to identify and repair common user interface problems through creating “overlays” on web pages as part of their regular use, thereby improving usability while reducing the need for professional services. In short, Social Overlays harnesses the diversity of experience and ideas within a community to &quot;crowd source&quot; usability. To evaluate Social Overlays, we examined whether a group of community members without any usability training could use Social Overlays to identify and repair UI problems on their medium–sized community’s website. We found that they could. Community users were able to uncover a large number of UI problems and formulate reasonable solutions to the problems they identified. In addition, we compared Social Overlays to two standard ways of assessing web-site usability: expert inspection and usability testing. We found that Social Overlays users identified more problems, and their reported problems differed in useful ways from those found by the experts and the usability testing team.&lt;/p&gt;
</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>47</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Jiang Yang</style></author><author><style face="normal" font="default" size="100%">Lada A. Adamic</style></author><author><style face="normal" font="default" size="100%">Mark S. Ackerman</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Crowdsourcing and Knowledge Sharing: Strategic User Behavior on Taskcn</style></title><secondary-title><style face="normal" font="default" size="100%">Proceedings of the 9th ACM Conference on Electronic Commerce</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">contests</style></keyword><keyword><style  face="normal" font="default" size="100%">crowdsourcing</style></keyword><keyword><style  face="normal" font="default" size="100%">e-commerce</style></keyword><keyword><style  face="normal" font="default" size="100%">knowledge market</style></keyword><keyword><style  face="normal" font="default" size="100%">learning</style></keyword><keyword><style  face="normal" font="default" size="100%">online communities</style></keyword><keyword><style  face="normal" font="default" size="100%">question-answer sites</style></keyword><keyword><style  face="normal" font="default" size="100%">virtual communities</style></keyword><keyword><style  face="normal" font="default" size="100%">witkey</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2008</style></year><pub-dates><date><style  face="normal" font="default" size="100%">08/2008</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">Complete</style></url></web-urls></urls><publisher><style face="normal" font="default" size="100%">ACM</style></publisher><pub-location><style face="normal" font="default" size="100%">New York, NY, USA</style></pub-location><pages><style face="normal" font="default" size="100%">246-255</style></pages><isbn><style face="normal" font="default" size="100%">978-1-60558-169-9</style></isbn><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;Witkeys are a thriving type of web-based knowledge sharing market in China, supporting a form of crowdsourcing. In a Witkey site, users offer a small award for a solution to a task, and other users compete to have their solution selected.&lt;/p&gt;&lt;p&gt;In this paper, we examine the behavior of users on one of the biggest Witkey websites in China, Taskcn.com. On Taskcn, we observed several characteristics in users&#039; activity over time. Most users become inactive after only a few submissions. Others keep attempting tasks. Over time, users tend to select tasks where they are competing against fewer opponents to increase their chances of winning. They will also, perhaps counterproductively, select tasks with higher expected rewards. Yet, on average, they do not increase their chances of winning, and in some categories of tasks, their chances actually decrease. This does not paint the full picture, however, because there is a very small core of successful users who manage not only to win multiple tasks, but to increase their win-to-submission ratio over time. This core group proposes nearly 20% of the winning solutions on the site. The patterns we observe on Taskcn, we believe, hold clues to the future of crowdsourcing and freelance marketplaces, and raise interesting design implications for such sites.&lt;/p&gt;</style></abstract></record></records></xml>