In the course of my graduate work at Harvard University, I paid hundreds of Americans living in poverty the equivalent of about $2 an hour. It was perfectly legal for me to do so, and my research had the approval of my university’s ethics board. I was not alone, or even unusual, in basing Ivy League research on less-than-Walmart wages; literally thousands of academic research projects pay the same substandard rates. Social scientists cannot pretend that the system is anything but exploitative. It is time for meaningful reform of crowdsourced research.

This is what crowdsourced research looks like. I posted a survey using Mechanical Turk (MTurk), a website run by Amazon.com. Across the country, hundreds of MTurk workers (“turkers”) agreed to fill out the survey in exchange for about 20 cents apiece, and within a few days I had my survey results. The process was easy, and above all, cheap. No wonder it is increasingly popular with academics; a search on Google Scholar returns thousands of academic papers citing MTurk, increasing from 173 in 2008 to 5,490 in 2014.

Mechanical Turk is a bargain for researchers, but not for workers. A survey typically takes a couple minutes per person, so the hourly rate is very low. This might be acceptable if all turkers were people with other jobs, for whom the payment was incidental. But scholars have known for years that the vast majority of MTurk tasks are completed by a small set of workers who spend long hours on the website, and that many of those workers are very poor. Here are the sobering facts:

• About 80 percent of tasks on MTurk are completed by about 20 percent of participants that spend more than 15 hours a week working on the site. MTurk works not because it has many hobbyists, but because it has dedicated people who treat the tasks like a job.
• About one in five turkers are earning less than $20,000 a year.
• A third of U.S. turkers call MTurk an important source of income, and more than one in ten say they use MTurk money to make basic ends meet.

Journal articles that refer to Mechanical Turk. Source: PS: Political Science and Politics

It is easy to forget that these statistics represent real people, so let me introduce you to one of them. “Marjorie” is a 53-year-old woman from Indiana who had jobs in a grocery store and as a substitute teacher before a bad fall left her unable to work. Now, she says, “I sit there for probably eight hours a day answering surveys. I’ve done over 8,000 surveys.” For these full days of work, Marjorie estimates that she makes “$100 per month” from MTurk, which supplements the $189 she receives in food stamps. Asked about her economic situation, Marjorie simply says that she is “poverty stricken.”

I heard similar stories from other MTurk workers—very poor people, often elderly or disabled, working tremendous hours online just to keep themselves and their families afloat. I spoke to a woman who never got back on her feet after losing her home in Hurricane Rita, and another who had barely escaped foreclosure. A mother of two was working multiple jobs, plus her time MTurk, to keep her family off government assistance. Job options are few for many turkers, especially those who are disabled, and MTurk provides resources they might not otherwise have. But these workers that work anonymously from home are isolated and have few avenues to organize for higher wages or other employment protections.

Once I realized how poorly paid my respondents were, I went back and gave every one of my over 1,400 participants a “bonus” to raise the survey respondent rate to the equivalent of a $10 hourly wage. (I paid an additional $15 to respondents who participated in an interview.) This cost me a little bit more money, but less than you might imagine. For a 3-minute survey of 800 people, going from a 20-cent to a 50-cent payment costs an additional $240. But if every researcher paid an ethical wage, it would really add up for people like Marjorie. In fact, it would likely double her monthly income from MTurk.

Raising wages is a start, but it should not be up to individual researchers to impose workplace standards. In this month’s PS: Political Science and Politics, a peer-reviewed journal published for the American Political Science Association, I have called for new standards for crowdsourced research to be implemented not only by individual researchers, but also by universities, journals, and grantmakers. For instance, journal editors should commit to publishing only those articles that pay respondents an ethical rate, and university ethics boards should create guidelines for use of crowdsourcing that consider wages and also crowdsourcers’ lack of access to basic employment protections.

The alternative is continuing to pay below-minimum-wage rates to a substantial number of poor people who rely on this income for their basic needs. This is simply no alternative at all.

This post originally appeared on the TechTank blog.

In the course of my graduate work at Harvard University, I paid hundreds of Americans living in poverty the equivalent of about $2 an hour. It was perfectly legal for me to do so, and my research had the approval of my university’s ethics board. I was not alone, or even unusual, in basing Ivy League research on less-than-Walmart wages; literally thousands of academic research projects pay the same substandard rates. Social scientists cannot pretend that the system is anything but exploitative. It is time for meaningful reform of crowdsourced research.

This is what crowdsourced research looks like. I posted a survey using Mechanical Turk (MTurk), a website run by Amazon.com. Across the country, hundreds of MTurk workers (“turkers”) agreed to fill out the survey in exchange for about 20 cents apiece, and within a few days I had my survey results. The process was easy, and above all, cheap. No wonder it is increasingly popular with academics; a search on Google Scholar returns thousands of academic papers citing MTurk, increasing from 173 in 2008 to 5,490 in 2014.

Mechanical Turk is a bargain for researchers, but not for workers. A survey typically takes a couple minutes per person, so the hourly rate is very low. This might be acceptable if all turkers were people with other jobs, for whom the payment was incidental. But scholars have known for years that the vast majority of MTurk tasks are completed by a small set of workers who spend long hours on the website, and that many of those workers are very poor. Here are the sobering facts:

• About 80 percent of tasks on MTurk are completed by about 20 percent of participants that spend more than 15 hours a week working on the site. MTurk works not because it has many hobbyists, but because it has dedicated people who treat the tasks like a job.
• About one in five turkers are earning less than $20,000 a year.
• A third of U.S. turkers call MTurk an important source of income, and more than one in ten say they use MTurk money to make basic ends meet.

Journal articles that refer to Mechanical Turk. Source: PS: Political Science and Politics

It is easy to forget that these statistics represent real people, so let me introduce you to one of them. “Marjorie” is a 53-year-old woman from Indiana who had jobs in a grocery store and as a substitute teacher before a bad fall left her unable to work. Now, she says, “I sit there for probably eight hours a day answering surveys. I’ve done over 8,000 surveys.” For these full days of work, Marjorie estimates that she makes “$100 per month” from MTurk, which supplements the $189 she receives in food stamps. Asked about her economic situation, Marjorie simply says that she is “poverty stricken.”

I heard similar stories from other MTurk workers—very poor people, often elderly or disabled, working tremendous hours online just to keep themselves and their families afloat. I spoke to a woman who never got back on her feet after losing her home in Hurricane Rita, and another who had barely escaped foreclosure. A mother of two was working multiple jobs, plus her time MTurk, to keep her family off government assistance. Job options are few for many turkers, especially those who are disabled, and MTurk provides resources they might not otherwise have. But these workers that work anonymously from home are isolated and have few avenues to organize for higher wages or other employment protections.

Once I realized how poorly paid my respondents were, I went back and gave every one of my over 1,400 participants a “bonus” to raise the survey respondent rate to the equivalent of a $10 hourly wage. (I paid an additional $15 to respondents who participated in an interview.) This cost me a little bit more money, but less than you might imagine. For a 3-minute survey of 800 people, going from a 20-cent to a 50-cent payment costs an additional $240. But if every researcher paid an ethical wage, it would really add up for people like Marjorie. In fact, it would likely double her monthly income from MTurk.

Raising wages is a start, but it should not be up to individual researchers to impose workplace standards. In this month’s PS: Political Science and Politics, a peer-reviewed journal published for the American Political Science Association, I have called for new standards for crowdsourced research to be implemented not only by individual researchers, but also by universities, journals, and grantmakers. For instance, journal editors should commit to publishing only those articles that pay respondents an ethical rate, and university ethics boards should create guidelines for use of crowdsourcing that consider wages and also crowdsourcers’ lack of access to basic employment protections.

The alternative is continuing to pay below-minimum-wage rates to a substantial number of poor people who rely on this income for their basic needs. This is simply no alternative at all.

Editor's Note: On Thursday Brookings Visiting Fellow, Amb. Norm Eisen addressed the Italian Parliament to discuss ethics in government, highlighting efforts in the US to improve transparency and accountability. In the speech, Amb. Eisen argues that while ethics reform can be difficult, it is an absolutely essentially part of any democratic system.

As Prepared For Delivery

Signora Presidente Boldrini, Madam President Brasseur, honorevoli Parlamentari, fellow panelists and distinguished guests, buon pomerigo. Thanks for inviting me to address the urgent subject of ethical standards in political life. It is an honor to be here in the Italian Chamber of Deputies, in this beautiful and ancient city, to which we Americans owe so many elements of our system of government. And in my town of Washington, DC we also borrowed a lot of your architecture, so we owe you for that as well.

In exchange for all that, as a small form of repayment, I would like to offer some perspectives from the U.S. as you consider the adoption of a code of ethical conduct for the Italian Parliament.

Since we are in the Chamber of Deputies, the equivalent of our U.S. Congress’ House of Representatives, I will start with best practices in that body, based on years of my professional life—too many—spent addressing alleged violations of its codes of conduct, including as a defense lawyer and later as the co-founder of a government watchdog group.

And I think there are also important lessons to be drawn from the new, innovative code of conduct for White House officials we established while I served as the "Ethics Czar" of President Obama. At his direction I helped write that new code, the Obama "ethics pledge," and although I am biased I think it has been effective so far, knock wood, there have been no major White House scandals. So I will talk about the lessons of that code of conduct a bit as well. My reflections are those of a friend and partner nation with plenty of challenges of our own. So I approach the issue with genuine humility in sharing our successes and failures.

I. Government ethics while standing on one leg

So—what is our U.S. view of best practices for the contents of government codes of ethics? In the U.S. and dare I say internationally, there is a pretty well developed set of best practices. In our House of Representatives, for example, our equivalent of this Chamber of Deputies, Rule XXIII is the Code of Official Conduct. It provides rules in four core areas;

• one, for regulating conflicts of interest, that is, situations where personal interests or financial holdings may conflict with official parliamentary duties;
• two, for gifts, particularly those from lobbyists and other persons interested in parliamentary decisions;
• three, for outside employment of parliamentarians before, during and after government service, particularly with lobbyists, a situation which we call in the US the revolving door; and
• four, for parliamentarians’ proper use of official resources, that is, hiring, staff, budget, travel and such.

There is much more detail in our code of conduct, and a few other rules as well, but those four items—conflicts, gifts, employment and resources—are the key. These same four key areas are also at the center of our codes of conduct for employees of our executive branch, as codified in our statutes and regulations, as well as in the Obama ethics pledge.

I emphasize these four key items because, having helped draft one code of conduct, and having often delved into many other codes, I sometimes find that I lose the forest for the trees when working with these codes, that the priorities at least for me sometimes get lost in the detail. So I try to keep the core always in mind, though I should add that the content of any such code must of course be particularized for the circumstances of particular government bodies and jurisdictions. Thus our U.S. House code is five pages long, elaborating on those four core items, and the House Ethics Manual of official guidance for the code is 456 pages long. Our Obama ethics pledge we got onto one page, we were proud of that. And we made everyone read and sign that page. To be fair, we could do that because we built on and added to other rules which already existed, and we did have several pages of definitions and references attached to the pledge.

II. Enforcement and transparency

But a good code is only the beginning. In our U.S. experience, just as important as the code, maybe even more important, is its enforcement. And here is where I want to share some lessons drawn from U.S. challenges in recent years, and how we responded. I am going to add two more items to our check list: enforcement and transparency.

Candidly, even with our parliamentary code of conduct in the U.S., our enforcement has sometime lagged. That is in part because under our Constitution, the ultimate enforcers are the parliamentarians themselves, and so they can at times be understandably reluctant to sanction their colleagues and friends. It's human nature.

For example, from about 1998 to 2004, there was a seven-year truce in filing complaints in our House of Representatives. The government watchdog organization I co-founded helped end that in 2004 by writing a complaint together with a brave but lonely member of Congress who was willing to file it with the House Ethics Committee. The resulting investigation resulted in the discipline of the member investigated, and ultimately helped lead to his party losing majority control of the body.

Out of all of that came a new enforcement tool in 2008, in our House of Representatives, that I strongly recommend to you: the creation of a new, independent entity, the Office of Congressional Ethics (OCE). This is a nonpartisan fact-finding body that investigates allegations from any source, including whistleblowers who might otherwise be afraid to step forward. OCE then recommends action to the parliamentarians who constitutionally maintain the ultimate decision-making power. Most importantly, the OCE referrals become public, allowing press, civil society and voter accountability. As a result, I believe, since the creation of the OCE for our House in 2008, there have been a significantly higher number of meritorious investigations there than in our Senate, which does not have a comparable body. The total is about 46 OCE referrals and about 20 House disciplinary actions versus just four letters of admonition by our Senate in that period. To be fair the Senate is a smaller body—but not that much smaller!

That last aspect of OCE enforcement—transparency, and the accountability it brings from media, NGOs and the public—is the sixth and final point I want to emphasize. In our U.S. parliamentary ethics system we have many transparency mechanisms: asset disclosures that our parliamentarians file, disclosures that lobbyists must make about their activities, information in campaign finance filings, and more.

To explain the value of transparency, I would like to close by turning to one of our Obama White House ethics transparency innovations. Starting in 2009, we for the first time put on the Internet virtually all visitor records of those coming to the White House. It used to be that just to get a handful of these records you had to file litigation and wait for years to know who was coming to the White House, who they were meeting with and what the subject of the meeting was. Now millions of Obama White House visitor records are online, each with a dozen or so basic categories of information: the name of the visitor, the person visited, the subject of the meeting and so on.

Why is that important? I began by referencing the Obama White House's record in avoiding major scandal. I think there are a number of reasons for that, including the President's own integrity and the new code of conduct we put into place. But an important part of that success story has also been the fact that records of White House meetings go on the Internet for everyone to see. That transparency brings accountability from the press, civil society and the public. That transparency and accountability has in turn powerfully reinforced the code of conduct: it has discouraged people from having meetings they shouldn't have, and if you don't have the meeting, you can't get in trouble for it.

So the U.S. view in one sentence: regulate conflicts, gifts, employment, and resource use, with strong enforcement and above all transparency. Thanks again for inviting me to share the U.S. perspective. Grazie!