--- title: "Mechanical Turk: Putting Humans Behind the Machines" id: "25778" type: "post" slug: "mechanical-turk-putting-humans-behind-the-machines" published_at: "2014-10-28T11:58:00+00:00" modified_at: "2026-03-16T12:57:59+00:00" url: "https://associationsnow.com/2014/10/28/mechanical-turk-putting-humans-behind-the-machines/" markdown_url: "https://associationsnow.com/2014/10/28/mechanical-turk-putting-humans-behind-the-machines.md" excerpt: "For years, Amazon has quietly built an army of online users who work on tiny tasks for low pay. For associations, the tool it created, Mechanical Turk, could prove an effective way to do market research and manage important but..." taxonomy_category: - "Ethics" taxonomy_post_tag: - "AssociationsNow" - "Ethics" - "labor laws" - "microtasks" - "Technology" taxonomy_content_format: - "Article" taxonomy_role: - "Director" - "Manager" - "VP" taxonomy_persona: - "Industry Professionals" --- [Home](https://associationsnow.com/) » [Articles](https://associationsnow.com/format/article/) » Mechanical Turk: Putting Humans Behind the Machines Nine years ago, Amazon took one of its earliest steps away from simply being a retail giant. To this day, the innovation is proving immensely helpful for testing, getting opinions, and doing research. Oddly enough, it’s powered by people—thousands of them. Before Amazon became known for the cloud or for tablets, the firm launched [Mechanical Turk (opens in a new tab)](https://www.mturk.com/mturk/welcome) , a service that allows organizations to pay small amounts for workers to conduct a series of microtasks (often a few cents per task)—work that takes a few minutes at best and can only be conducted by humans, not machines. It was kind of a crazy idea that nobody knew what to do with at first. It drew [massive hype (opens in a new tab)](http://techcrunch.com/2005/11/04/amazon-finally-shows-itself-as-the-matrix/) , but after its [initial buzz (opens in a new tab)](http://mashable.com/2005/11/04/amazon-mechanical-turk-human-processing-for-web-20/) , it became a modest, utilitarian part of the web—it’s never gone away, but it’s never been a limelight-stealer. But the microtask is having a bit of a moment right now, as organizations and companies alike have found ways to make it work for them. A couple examples: **Last week, *The Washington Post*** noted that the Federal Election Commission had hired a firm, [Captricity (opens in a new tab)](http://captricity.com/) , that promises to digitize and put online, in a matter of hours, the lengthy, detailed printed documents that the commission receives from political campaigns. How? Short version: [The company has figured out a way to use Mechanical Turk (opens in a new tab)](http://www.washingtonpost.com/blogs/the-switch/wp/2014/10/24/campaign-finance-officials-aim-to-cure-the-paper-obsessed-senate-through-crowd-sourcing-algorithms/) to enlist people (“Turkers,” as workers on the platform are often called) to enter certain data from the forms, and then uses machine learning to fill in the gaps. Pretty cool, huh? **In a *Priceonomics* blog post** published earlier this month, author Rosie Cima noted that [the platform has been a boon for behavioral science (opens in a new tab)](http://priceonomics.com/mechanical-turk-new-face-of-behavioral-science/) in the academic world because it exposes significant numbers of people to potential research studies. “But even if Turkers in total ‘are not representative’ of ‘any population,’ researchers can slice them down into cleaner demographic samples,” she explains. “Just like they have the option of only allowing Turkers with a certain quality score to complete their tasks, they can also do things like only allow U.S. residents.” The pool of potential research subjects, she notes, is particularly strong in India and the United States. ### Is it Ethical? Admittedly, services like Mechanical Turk raise some ethical questions. The complaints started back in 2005, and they’ve never really gone away. A 2012 [piece by East Bay Express writer Ellen Kushing (opens in a new tab)](http://www.eastbayexpress.com/oakland/dawn-of-the-digital-sweatshop/Content?oid=3301022) highlights the main arguments: > Numbers are hard to track and vary from worker to worker, but [New York University professor Panos Ipeirotis] has estimated the average hourly wage [for Turkers] to be roughly $2, while Joel Ross of UC Irvine’s Department of Informatics places it closer to $1.25—and whatever it is, it’s certainly lower than the federal minimum wage of $7.25. But that’s not all: Embedded in Amazon’s 5,200-plus-word Terms of Use agreement is a clause that essentially allows employers to reject an employee’s work whenever they want, no questions asked. Talk to enough Turkers and most of them will relay some version of the same story: They completed a task, all or part of which was rejected, and never found out why. While active Turkers have struggled to deal with these issues, they’ve worked to find common ground: Earlier this year, an online community for active Turkers, [Dynamo (opens in a new tab)](http://www.wearedynamo.org/) , created a set of worker guidelines specifically for the academic community, which [include standards for ethical pay (opens in a new tab)](http://wiki.wearedynamo.org/index.php/Guidelines_for_Academic_Requesters) . So far, 28 researchers from schools such as Harvard, Carnegie Mellon, and Stanford University have agreed to follow the standards. Interestingly, though, *Priceonomics* offers these two points: [Research shows (opens in a new tab)](http://www.researchgate.net/publication/221519699_Who_are_the_crowdworkers_shifting_demographics_in_mechanical_turk) that most people who work on these tasks in the U.S. aren’t in it as a full-time gig but as a way to kill time and earn some extra money on the side. And dedicated users in India can make amounts approaching an average wage for that country. Nonetheless, it’s worth considering these issues when deciding if using Mechanical Turk is a good idea for you. ### A Few Turking Ideas So what could you use an army of modestly paid workers for, anyway? Here are a few of the more common ideas out there: **Instant focus groups:** Testing a new website with a certain audience? You can hop on a service like Mechanical Turk and get quick feedback from a small audience for pennies on the dollar. (Google recently did this [when testing out a new interface (opens in a new tab)](http://www.androidpolice.com/2014/10/25/google-is-testing-a-material-design-makeover-for-mobile-web-search-and-you-can-try-it-out-now/) for its mobile search.) Likewise, if you want to test messaging with a large number of people over a short period of time, it’s a great way to do so. **Conduct a study:** For social science-related research, Mechanical Turk and similar services are well suited for posing quick questions. Want to research how people feel about a certain topic related to your industry? It could be a great way to test the waters. **Growth hacking:** Occasionally, Mechanical Turk publishers hit on truly brilliant uses of the platform. A good example [comes from the firm ThingsWeStart (opens in a new tab)](http://customerdevlabs.com/2013/09/24/google-news-api-mturk-press/#) , which used a combination of the Google News API and Mechanical Turk to collect contact information for reporters covering a relevant beat. It only cost $10.50 to collect the info over a couple of days and earned the firm [13 separate press write-ups (opens in a new tab)](https://bitly.com/bundles/justinwi/1) . **Offload annoying tasks:** Auditing old content on a website to make sure information is current, or if links still work, is a pain. But having a Turker [do something like audio transcription (opens in a new tab)](http://chronicle.com/blogs/profhacker/the-reliability-efficiencyaffordability-of-amazons-mechanical-turk/22994) could allow you to refocus your staff members on less tedious tasks. That taxonomy you’re building could become a little less taxing. ### Does This Make Sense for Associations? You might be wondering: What the heck does this have to do with the association space? As it turns out, it has a lot in common with a concept that’s been often touted among association pros. The idea of [micro-volunteering](http://associationsnow.com/2013/10/micro-volunteering-all-hands-on-deck/) —asking members to assist in very small ways, such as having them greet attendees at an event, set up or tear down a meeting room, or comment regularly on a community forum—is effectively the same kind of territory. As my colleague Joe Rominiecki [pointed out last year](http://associationsnow.com/2013/10/how-micro-volunteering-builds-association-ownership/) , they help build a sense of ownership in a community. But sometimes a task is too small or tedious to ask a member to do. Or maybe it requires fresh eyes that members don’t have because they know you too well. Maybe research important to your field requires people who know little about the space in which you work. You lose the ownership and engagement elements, but you could gain some useful benefits in the process—such as a little less pressure on an overworked small staff that needs the extra bandwidth. Mechanical Turk—the name, by the way, [has a great backstory (opens in a new tab)](http://en.wikipedia.org/wiki/The_Turk) —isn’t for everyone. But given the appropriate task and business need, it could prove a fascinating boon for the right organization. Now if you’ll excuse me, [I have a few sheep to draw (opens in a new tab)](http://users.design.ucla.edu/~akoblin/work/thesheepmarket/) . (Wikimedia Commons) [Ernie Smith](https://associationsnow.com/author/ernie-smith/) Ernie Smith is a former senior editor for Associations Now. [More articles by this author](https://associationsnow.com/author/ernie-smith/) Tags: [#Ethics](https://associationsnow.com/tag/ethics/) [#labor laws](https://associationsnow.com/tag/labor-laws/) [#microtasks](https://associationsnow.com/tag/microtasks/) [#Technology](https://associationsnow.com/tag/technology/) **Stay Informed** [Subscribe to our free newsletter](https://associationsnow.com/newsletter/) , *Associations Now Daily News*, to find out what’s happening in the association world every business day. ## You Might Like - [PodcastAssociations Now Presents: Beyond the Tech Stack: How AI Is Changing the Association PlaybookOctober 29, 2026](https://associationsnow.com/2026/10/29/associations-now-presents-beyond-the-tech-stack-how-ai-is-changing-the-association-playbook/) - [VideoUrban Land Institute- Project Recovery: Rebuilding Los Angeles After the January 2025 WildfiresSeptember 24, 2026](https://associationsnow.com/2026/09/24/urban-land-institute-project-recovery-rebuilding-los-angeles-after-the-january-2025-wildfires/) - [PodcastAssociations NOW Presents: All for the Love of Chicago: Rethinking the Destination ExperienceSeptember 10, 2026](https://associationsnow.com/2026/09/10/associations-now-presents-all-for-the-love-of-chicago-rethinking-the-destination-experience/) - [VideoExploring New Frontiers: Leadership, Resilience and the Future of SpaceflightAugust 27, 2026](https://associationsnow.com/2026/08/27/exploring-new-frontiers-leadership-resilience-and-the-future-of-spaceflight/) ## Comments **Comments are for ASAE members.** [Learn more about comments on this site.](https://associationsnow.com/comments/) [Log in](https://associationsnow.com/login?redirect_to=https%3A%2F%2Fassociationsnow.com%2F2014%2F10%2F28%2Fmechanical-turk-putting-humans-behind-the-machines%2F%23comments) to your member account or [join ASAE](https://my.asaecenter.org/select-a-membership-type/) !