our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.





our

The Global Pandemic Has Spawned New Forms of Activism — and They're Flourishing

The authors have identified nearly 100 distinct methods of nonviolent action that include physical, virtual and hybrid actions.




our

The Russians Manipulated Our Elections. We Helped.

When Russian intelligence officers plotted their campaign to destabilize American politics in 2016, they had nearly a century of experience in covert manipulation to draw upon. The Internet had given the Russians new tools for this mischief. But their secret weapon was us — an open, divided, angry America.




our

'We must keep our feet on the ground' - di Montezemolo

Ferrari is not underestimating its rivals Red Bull and McLaren heading into the final two rounds of the season, despite Fernando Alonso taking an 11 point lead in the drivers' championship with victory at the Korean Grand Prix




our

Red Bull still favourites - Alonso

New championship leader Fernando Alonso believes Red Bull still has the advantage in the title race and is expecting the championship to go down to the wire at the final round in Abu Dhabi




our

Ricciardo encouraged by Renault driveability progress

Daniel Ricciardo says Renault has solved many of the driveability issues which hampered Red Bull so drastically in Melbourne




our

Ricciardo happy to settle for fourth on grid

Daniel Ricciardo thinks Red Bull can be happy with a spot on the second row on the grid in Malaysia after struggling at the season-opening Australian Grand Prix




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.




our

Can crowdsourcing be ethical?


In the course of my graduate work at Harvard University, I paid hundreds of Americans living in poverty the equivalent of about $2 an hour. It was perfectly legal for me to do so, and my research had the approval of my university’s ethics board. I was not alone, or even unusual, in basing Ivy League research on less-than-Walmart wages; literally thousands of academic research projects pay the same substandard rates. Social scientists cannot pretend that the system is anything but exploitative. It is time for meaningful reform of crowdsourced research.

This is what crowdsourced research looks like. I posted a survey using Mechanical Turk (MTurk), a website run by Amazon.com. Across the country, hundreds of MTurk workers (“turkers”) agreed to fill out the survey in exchange for about 20 cents apiece, and within a few days I had my survey results. The process was easy, and above all, cheap. No wonder it is increasingly popular with academics; a search on Google Scholar returns thousands of academic papers citing MTurk, increasing from 173 in 2008 to 5,490 in 2014.

Mechanical Turk is a bargain for researchers, but not for workers. A survey typically takes a couple minutes per person, so the hourly rate is very low. This might be acceptable if all turkers were people with other jobs, for whom the payment was incidental. But scholars have known for years that the vast majority of MTurk tasks are completed by a small set of workers who spend long hours on the website, and that many of those workers are very poor. Here are the sobering facts:

  • About 80 percent of tasks on MTurk are completed by about 20 percent of participants that spend more than 15 hours a week working on the site. MTurk works not because it has many hobbyists, but because it has dedicated people who treat the tasks like a job.
  • About one in five turkers are earning less than $20,000 a year.
  • A third of U.S. turkers call MTurk an important source of income, and more than one in ten say they use MTurk money to make basic ends meet.

Journal articles that refer to Mechanical Turk. Source: PS: Political Science and Politics

It is easy to forget that these statistics represent real people, so let me introduce you to one of them. “Marjorie” is a 53-year-old woman from Indiana who had jobs in a grocery store and as a substitute teacher before a bad fall left her unable to work. Now, she says, “I sit there for probably eight hours a day answering surveys. I’ve done over 8,000 surveys.” For these full days of work, Marjorie estimates that she makes “$100 per month” from MTurk, which supplements the $189 she receives in food stamps. Asked about her economic situation, Marjorie simply says that she is “poverty stricken.”

I heard similar stories from other MTurk workers—very poor people, often elderly or disabled, working tremendous hours online just to keep themselves and their families afloat. I spoke to a woman who never got back on her feet after losing her home in Hurricane Rita, and another who had barely escaped foreclosure. A mother of two was working multiple jobs, plus her time MTurk, to keep her family off government assistance. Job options are few for many turkers, especially those who are disabled, and MTurk provides resources they might not otherwise have. But these workers that work anonymously from home are isolated and have few avenues to organize for higher wages or other employment protections.

Once I realized how poorly paid my respondents were, I went back and gave every one of my over 1,400 participants a “bonus” to raise the survey respondent rate to the equivalent of a $10 hourly wage. (I paid an additional $15 to respondents who participated in an interview.) This cost me a little bit more money, but less than you might imagine. For a 3-minute survey of 800 people, going from a 20-cent to a 50-cent payment costs an additional $240. But if every researcher paid an ethical wage, it would really add up for people like Marjorie. In fact, it would likely double her monthly income from MTurk.

Raising wages is a start, but it should not be up to individual researchers to impose workplace standards. In this month’s PS: Political Science and Politics, a peer-reviewed journal published for the American Political Science Association, I have called for new standards for crowdsourced research to be implemented not only by individual researchers, but also by universities, journals, and grantmakers. For instance, journal editors should commit to publishing only those articles that pay respondents an ethical rate, and university ethics boards should create guidelines for use of crowdsourcing that consider wages and also crowdsourcers’ lack of access to basic employment protections.

The alternative is continuing to pay below-minimum-wage rates to a substantial number of poor people who rely on this income for their basic needs. This is simply no alternative at all.

Image Source: © Romeo Ranoco / Reuters
      
 
 




our

Can crowdsourcing be ethical?


This post originally appeared on the TechTank blog.

In the course of my graduate work at Harvard University, I paid hundreds of Americans living in poverty the equivalent of about $2 an hour. It was perfectly legal for me to do so, and my research had the approval of my university’s ethics board. I was not alone, or even unusual, in basing Ivy League research on less-than-Walmart wages; literally thousands of academic research projects pay the same substandard rates. Social scientists cannot pretend that the system is anything but exploitative. It is time for meaningful reform of crowdsourced research.

This is what crowdsourced research looks like. I posted a survey using Mechanical Turk (MTurk), a website run by Amazon.com. Across the country, hundreds of MTurk workers (“turkers”) agreed to fill out the survey in exchange for about 20 cents apiece, and within a few days I had my survey results. The process was easy, and above all, cheap. No wonder it is increasingly popular with academics; a search on Google Scholar returns thousands of academic papers citing MTurk, increasing from 173 in 2008 to 5,490 in 2014.

Mechanical Turk is a bargain for researchers, but not for workers. A survey typically takes a couple minutes per person, so the hourly rate is very low. This might be acceptable if all turkers were people with other jobs, for whom the payment was incidental. But scholars have known for years that the vast majority of MTurk tasks are completed by a small set of workers who spend long hours on the website, and that many of those workers are very poor. Here are the sobering facts:

  • About 80 percent of tasks on MTurk are completed by about 20 percent of participants that spend more than 15 hours a week working on the site. MTurk works not because it has many hobbyists, but because it has dedicated people who treat the tasks like a job.
  • About one in five turkers are earning less than $20,000 a year.
  • A third of U.S. turkers call MTurk an important source of income, and more than one in ten say they use MTurk money to make basic ends meet.

Journal articles that refer to Mechanical Turk. Source: PS: Political Science and Politics

It is easy to forget that these statistics represent real people, so let me introduce you to one of them. “Marjorie” is a 53-year-old woman from Indiana who had jobs in a grocery store and as a substitute teacher before a bad fall left her unable to work. Now, she says, “I sit there for probably eight hours a day answering surveys. I’ve done over 8,000 surveys.” For these full days of work, Marjorie estimates that she makes “$100 per month” from MTurk, which supplements the $189 she receives in food stamps. Asked about her economic situation, Marjorie simply says that she is “poverty stricken.”

I heard similar stories from other MTurk workers—very poor people, often elderly or disabled, working tremendous hours online just to keep themselves and their families afloat. I spoke to a woman who never got back on her feet after losing her home in Hurricane Rita, and another who had barely escaped foreclosure. A mother of two was working multiple jobs, plus her time MTurk, to keep her family off government assistance. Job options are few for many turkers, especially those who are disabled, and MTurk provides resources they might not otherwise have. But these workers that work anonymously from home are isolated and have few avenues to organize for higher wages or other employment protections.

Once I realized how poorly paid my respondents were, I went back and gave every one of my over 1,400 participants a “bonus” to raise the survey respondent rate to the equivalent of a $10 hourly wage. (I paid an additional $15 to respondents who participated in an interview.) This cost me a little bit more money, but less than you might imagine. For a 3-minute survey of 800 people, going from a 20-cent to a 50-cent payment costs an additional $240. But if every researcher paid an ethical wage, it would really add up for people like Marjorie. In fact, it would likely double her monthly income from MTurk.

Raising wages is a start, but it should not be up to individual researchers to impose workplace standards. In this month’s PS: Political Science and Politics, a peer-reviewed journal published for the American Political Science Association, I have called for new standards for crowdsourced research to be implemented not only by individual researchers, but also by universities, journals, and grantmakers. For instance, journal editors should commit to publishing only those articles that pay respondents an ethical rate, and university ethics boards should create guidelines for use of crowdsourcing that consider wages and also crowdsourcers’ lack of access to basic employment protections.

The alternative is continuing to pay below-minimum-wage rates to a substantial number of poor people who rely on this income for their basic needs. This is simply no alternative at all.

Image Source: © Romeo Ranoco / Reuters
      
 
 




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Congestion pricing is all around us. Why is it taboo on our roads?

Think about a day in the life of a typical office worker in the Washington, D.C. area. They take Metro to get to the office on time, order lunch to be delivered from the busy restaurant down the street, purchase tickets to a weekend matinee film, and call a Lyft home as hockey fans swarm…

       




our

To fix our infrastructure, Washington needs to start from scratch

The 2016 presidential election felt like a watershed moment for federal infrastructure reform. For the first time in decades, both the Democratic and Republican presidential candidates made infrastructure a central component of their platforms. Their proposals reflected years of consistent calls for congressional action from groups representing cities, states, and industries—all of whom welcomed the…

       




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

The Global Pandemic Has Spawned New Forms of Activism — and They're Flourishing

The authors have identified nearly 100 distinct methods of nonviolent action that include physical, virtual and hybrid actions.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Schumacher content with fourth

Michael Schumacher confessed himself satisfied with his best result of the season after finishing fourth in the Spanish Grand Prix




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.




our

The Russians Manipulated Our Elections. We Helped.

When Russian intelligence officers plotted their campaign to destabilize American politics in 2016, they had nearly a century of experience in covert manipulation to draw upon. The Internet had given the Russians new tools for this mischief. But their secret weapon was us — an open, divided, angry America.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Hamilton leads McLaren front row, Vettel fourth and Alonso seventh

Lewis Hamilton took pole position as part of a McLaren front-row lockout at the Brazilian Grand Prix as championship contenders Sebastian Vettel and Fernando Alonso only managed fourth and eighth respectively




our

Lotus pair encouraged by upgrade

Heikki Kovalainen and Jarno Trulli were both encouraged that the new rear wing was a step forward for Lotus at Interlagos




our

Destiny in our hands - Gascoyne

Mike Gascoyne believes that Caterham's new identity will allow it to push on and beat the more established teams in Formula One




our

The Global Pandemic Has Spawned New Forms of Activism — and They're Flourishing

The authors have identified nearly 100 distinct methods of nonviolent action that include physical, virtual and hybrid actions.




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

Accumulating Evidence Using Crowdsourcing and Machine Learning: A Living Bibliography about Existential Risk and Global Catastrophic Risk

The study of existential risk — the risk of human extinction or the collapse of human civilization — has only recently emerged as an integrated field of research, and yet an overwhelming volume of relevant research has already been published. To provide an evidence base for policy and risk analysis, this research should be systematically reviewed. In a systematic review, one of many time-consuming tasks is to read the titles and abstracts of research publications, to see if they meet the inclusion criteria. The authors show how this task can be shared between multiple people (using crowdsourcing) and partially automated (using machine learning), as methods of handling an overwhelming volume of research.




our

The Global Pandemic Has Spawned New Forms of Activism — and They're Flourishing

The authors have identified nearly 100 distinct methods of nonviolent action that include physical, virtual and hybrid actions.




our

Sakhir circuit to honour Schumacher

The first corner at the Sakhir circuit used for the Bahrain Grand Prix is to be named after Michael Schumacher




our

'Small encouraging signs' for Schumacher

Michael Schumacher's condition is showing "small encouraging signs" of recovery, though he remains in the wake-up phase from his medically-induced coma




our

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government.

Rami Khouri's interview on Aljazeera TV discussing the appointment of the new Lebanese government amidst continuing protests and clashes with police.




our

Lebanon has formed a controversial new government in a polarised, charged atmosphere, and protesters are not going to be easily pacified by its promises, explains Rami Khoury.

The fourth consecutive month of Lebanon's unprecedented political and economic crisis kicked off this week with three dramatic developments that will interplay in the coming months to define the country's direction for years to come: Escalating protests on the streets, heightened security measures by an increasingly militarising state, and now, a new cabinet of controversial so-called "independent technocrats" led by Prime Minister-designate Hassan Diab.

Seeking to increase pressure on the political elite to act responsibly amid inaction vis-a-vis the slow collapse of the economy, the protesters had launched the fourth month of their protest movement, which had begun on 17 October last year, with a 'Week of Anger', stepping up their tactics and targeting banks and government institutions.




our

Rami Khouri on Euronews TV discussing the Trump-Netanyahu Middle East initiative.

Rami Khouri's on Euronews TV discussing the Trump-Netanyahu Middle East initiative.