In last Thursday’s GOP debate, Marco Rubio, Ted Cruz, Jeb Bush and Chris Christie managed to avoid mentioning their common proposal to “reform entitlements” by raising the Social Security retirement age from 67 to 70. That was probably a good idea. Their proposal only demonstrates their lack of understanding about the demographics of older Americans, especially the dramatic disparities in their life expectancy associated with education and race. Recent research on life expectancy indicates that their proposed change would effectively nullify Social Security for millions of Americans and sharply limit benefits for many millions more.. While many people in their 30s and 40s today can look forward to living into their 80s, the average life expectancy for the majority of Americans who do not hold a college degree hovers closer to 70, or the average life expectancy for all Americans in 1950.

The Widening Inequalities in the Life Spans of Americans

This research, summarized recently in a study published in Health Affairs, found that life expectancy for various age cohorts of Americans is closely associated with both educational achievement and race. For example, the average life expectancy for college-educated American men who were age 25 in 2008, or age 33 today, is 81.7 years for whites and 78.2 years for blacks. (Table 1, below) By contrast, the projected, average life span of high-school educated males, also age 25 in 2008 or 33 today, is 73.2 years for whites and 69.3 years for blacks. Women on average live longer than men; but similar disparities based on education and race are evident. The average life expectancy of women age 25 in 2008, or 33 years old today, was 79 years for whites and 75.4 years for blacks for those with a high school diploma, and 84.7 years for whites and 81.6 years for blacks with college degrees. Most disturbing, the average life expectancy of Americans age 25 in 2008 without a high school diploma is just 68.6 years for white men, 68.2 years for black men, 74.2 years for white women, and 74.9 years for black women. Surprisingly, the researchers found that Hispanics in this age group have the longest life expectancies, even though they also have the lowest average levels of education. Since these data are anomalous and may reflect sampling problems, we will focus mainly on the life-expectancy gaps between African American and white Americans.

Tallying How Many People Are Adversely Affected

Census data on the distribution by education of people age 25 to 34 in 2010 (ages 30 to 39 in 2015) provide a good estimate of how many Americans are adversely affected by these growing differences. Overall, 56.3 percent of all Americans currently in their 30s fall are high school graduates or left school without a high school diploma, educational groups with much lower average life expectancies. (Table 2, below) More precisely, 10.1 percent or almost 4.8 million Americans in their 30s today lack a high school diploma, and 46.2 percent or 18.9 million thirty-somethings have high school diplomas and no further degrees. All told, they account for 23,702,000 Americans in their 30s; and among older Americans, the numbers and percentages are even higher.

Since race as well as education are major factors associated with differences in life expectancy, we turn next to education by race (Table 3, below). The totals differ modestly from Table 2, because Census data on education by race cover ages 30-39 in 2014, while Table 2 covers age 30-39 in 2015 (ages 25-34 in 2010).

• Among people in their 30s today, 45.4 percent of whites or 10,613,000 Americans have a high school degree or less – and their average life expectancy is 9.4 years less than whites in their 30s with a college or associate degree.
• Among people in their 30s todays, 64.4 percent of blacks or 3,436,000 Americans have a high school degree or less – and their life expectancy is 8.6 years less than blacks in their 30s with an B.A. or associate degree, and 11.6 years less than whites with a college or associate degree..
• Among people in their 30s today, 75.6 percent of Hispanics or 6,243,000 Americans have a high school degree or less – and their life expectancy is 5.0 years less than Hispanics in their 30s with a college or associate degree.

As a policy matter, these data tell us that across all communities—white, black, Hispanic—improvements in secondary education to prepare everyone for higher education, and lower-cost access to higher education, can add years to the lives of millions of Americans.

Preserving Meaningful Access to Social Security Benefits

The widening inequalities in average life expectancy associated with race and education have more direct policy implications for Social Security, because the number of years that people can claim its benefits depends on their life spans. The growing inequalities in life expectancy translate directly into growing disparities in the years people can claim Social Security benefits, based on their education and race. Assuming that Americans in their 30s today retire at age 67 (the age for full benefits for this age group), they can expect to claim retirement benefits, on average, ranging from 1.2 years to 19.3 years, based on their education and race. (Table 4, below)

The most pressing issues of life expectancy and Social Security involve white males, black males, and black females without college degrees: Among Americans age 33 today, white and black men without high school diplomas and black males with high school degrees, on average, can expect to live long enough to collect benefits for less than three years. Similarly, white and black women without high school diplomas and black women with high school degrees, on average, can expect to collect benefits for less than eight years. Together, they account for 25.2 percent of whites and 64.4 percent of blacks in their 30s today. By contrast, male and female white college graduates age 33 today, on average, can expect to collect Social Security for between 14.7 and 17.7 years, respectively; and 33-year old black men and women with college degrees, on average, will claim benefits for 11.2 to 14.6 years, respectively.

These findings dictate that proposals to raise the Social Security retirement age should be rejected as a matter of basic fairness. Among this year’s presidential hopefuls, as noted earlier, Ted Cruz, Marco Rubio, Jeb Bush and Chris Christie all have called for raising the retirement age to 70 years. Under this policy, black men in their 30s today without a college degree and white men now in their 30s without a high school diploma, on average, would not live long enough to collect any Social Security. The change would reduce the average number of years of Social Security for Americans in their 30s today,

• From 1.6 years to -1.4 years for white men with no high school diploma,
• From 1.2 years to -1.8 years for black men with no high school diploma, and
• From 2.3 years to – 0.7 years for black, male high-school graduates.

Furthermore, among Americans in their 30s today, white and black women without a high school diploma, white male high school graduates, and black female high school graduates, would live long enough, on average, to collect Social Security for just 3.2 to 5.4 years. The GOP change reduce the average number of years of Social Security for Americans in their 30s today,

• From 6.2 years to 3.2 years for white, male high school graduates,
• From 7.2 years to 4.2 years for white women with no high school diploma,
• From 7.9 years to 4.9 years for black women with no high school diploma, and
• From 8.4 years to 5.4 years for black, female high-school graduates.

All told, proposals to raise the retirement age to 70 years old would mean, based on the average life expectancy of Americans in their 30s today, that 25.2 percent of whites in their 30s and 64.4 percent of blacks of comparable age, after working for 35 years or more, would receive Social Security benefits for 5.4 years or less.

Gary Burtless, a senior fellow in Economic Studies, explains new research on the growing longevity gap between high-income and low-income Americans, especially among the aged.

“Life expectancy difference of low income workers, middle income workers, and high income workers has been increasing over time,” Burtless says. “For people born in 1920 their life expectancy was not as long typically as the life expectancy of people who were born in 1940. But those gains between those two birth years were very unequally distributed if we compare people with low mid-career earnings and people with high mid-career earnings.” Burtless also discusses retirement trends among the educated and non-educated, income inequality among different age groups, and how these trends affect early or late retirement rates.

Also stay tuned for our regular economic update with David Wessel, who also looks at the new research and offers his thoughts on what it means for Social Security.

Show Notes

Later retirement, inequality and old age, and the growing gap in longevity between rich and poor

Disparity in Life Spans of the Rich and the Poor Is Growing

Subscribe to the Brookings Cafeteria on iTunes, listen on Stitcher, and send feedback email to BCP@Brookings.edu.

Researchers have long known that the rich live longer than the poor. Evidence now suggests that the life expectancy gap is increasing, at least here the United States, which raises troubling questions about the fairness of current efforts to protect Social Security.

There's nothing particularly mysterious about the life expectancy gap. People in ill health, who are at risk of dying relatively young, face limits on the kind and amount of work they can do. By contrast, the rich can afford to live in better and safer neighborhoods, can eat more nutritious diets and can obtain access to first-rate healthcare. People who have higher incomes, moreover, tend to have more schooling, which means they may also have better information about the benefits of exercise and good diet.

Although none of the above should come as a surprise, it's still disturbing that, just as income inequality is growing, so is life-span inequality. Over the last three decades, Americans with a high perch in the income distribution have enjoyed outsized gains.

Using two large-scale surveys, my Brookings colleagues and I calculated the average mid-career earnings of each interviewed family; then we estimated the statistical relationship between respondents' age at death and their incomes when they were in their 40s. We found a startling spreading out of mortality differences between older people at the top and bottom of the income distribution.

For example, we estimated that a woman who turned 50 in 1970 and whose mid-career income placed her in the bottom one-tenth of earners had a life expectancy of about 80.4. A woman born in the same year but with income in the top tenth of earners had a life expectancy of 84.1. The gap in life expectancy was about 3½ years. For women who reached age 50 two decades later, in 1990, we found no improvement at all in the life expectancy of low earners. Among women in the top tenth of earners, however, life expectancy rose 6.4 years, from 84.1 to 90.5. In those two decades, the gap in life expectancy between women in the bottom tenth and the top tenth of earners increased from a little over 3½ years to more than 10 years.

Our findings for men were similar. The gap in life expectancy between men in the bottom tenth and top tenth of the income distribution increased from 5 years to 12 years over the same two decades.

Rising longevity inequality has important implications for reforming Social Security. Currently, the program takes in too little money to pay for all benefits promised after 2030. A common proposal to eliminate the funding shortfall is to increase the full retirement age, currently 66. Increasing the age for full benefits by one year has the effect of lowering workers' monthly checks by 6% to 7.5%, depending on the age when a worker first claims a pension.

For affluent workers, any benefit cut will be partially offset by gains in life expectancy. Additional years of life after age 65 increase the number years these workers collect pensions. Workers at the bottom of the wage distribution, however, are not living much longer, so the percentage cut in their lifetime pensions will be about the same as the percentage reduction in their monthly benefit check.

Our results and other researchers' findings suggest that low-income workers have not shared in the improvements in life expectancy that have contributed to Social Security's funding problem.

It therefore seems unfair to preserve Social Security by cutting future benefits across the board. Any reform in the program to keep it affordable should make special provision to protect the benefits of low-wage workers.

Editor's note: This piece originally appeared in The Los Angeles Times. 

Gary Burtless, a senior fellow in Economic Studies, explains new research on the growing longevity gap between high-income and low-income Americans, especially among the aged.

“Life expectancy difference of low income workers, middle income workers, and high income workers has been increasing over time,” Burtless says. “For people born in 1920 their life expectancy was not as long typically as the life expectancy of people who were born in 1940. But those gains between those two birth years were very unequally distributed if we compare people with low mid-career earnings and people with high mid-career earnings.” Burtless also discusses retirement trends among the educated and non-educated, income inequality among different age groups, and how these trends affect early or late retirement rates.

Also stay tuned for our regular economic update with David Wessel, who also looks at the new research and offers his thoughts on what it means for Social Security.

Show Notes

Later retirement, inequality and old age, and the growing gap in longevity between rich and poor

Disparity in Life Spans of the Rich and the Poor Is Growing

Subscribe to the Brookings Cafeteria on iTunes, listen on Stitcher, and send feedback email to BCP@Brookings.edu.

Five years pass so quickly. It seems like only yesterday that EU leaders were emerging from an unseemly and apparently ad hoc appointment process to announce that Catherine Ashton, a member of the British House of Lords and a recently appointed European trade commissioner, would be the first-ever high representative for foreign affairs and security policy -- a sort of EU foreign minister. One existential currency crisis and two Russian invasions of Ukraine later, the EU is picking her successor.

With the passage of time and the rush of events, the stakes have become much higher. Yet the EU continues to select its leaders as if its postmodern continental paradise were not under siege from the south, because of the disintegration of the Arab world, and to the east, thanks to Russian aggression. Just like last time, the selection of the new high representative, Federica Mogherini, was undignified, full of haggling, and more focused on her gender, party affiliation, and nationality than on her actual qualifications for the job. And those are few: Mogherini emerged from obscurity just a few months ago to become Italy’s foreign minister.

Critics look at Mogherini’s lack of experience and assume that the EU’s underperformance in foreign policy will continue. This is a real possibility, and with crises brewing to Europe’s east and south, this is a particularly bad moment for the EU to descend into a bout of internal squabbling. But Mogherini can transcend the process that selected her and be the foreign policy representative the EU needs if she learns a few lessons from the recent past.

Back in 2009, pundits were filled with hope about the new EU foreign policy chief. The post was new and newly empowered to set up a diplomatic corps, the European External Action Service (EEAS). Against this backdrop, the choice of Ashton, an unknown British politician with no foreign policy experience, came as a cold shower. Her appointment reinforced the perception that the EU leaders’ stated resolve to raise the union’s foreign policy profile was rhetorical rather than real.

Although understandable, both the high expectations and the subsequent disappointment were misplaced. Even a high representative with an impeccable résumé would not have turned the EU into a foreign policy juggernaut. After all, the EU high representative is not a U.S. secretary of state with plenty of space to set U.S. foreign policy, but a bureaucrat operating within the much narrower limits of intergovernmental decision-making. In the EU, it is the member states -- not Brussels -- that make decisions on the most consequential issues of foreign policy.

Ashton has operated well within this limited sphere and carefully picked her issues. She has understood that the role of the high representative must change depending on the degree of agreement among the states. When there is a strong consensus, the high representative’s role most closely resembles that of a normal foreign minister -- he or she has great leeway to devise and implement policies. The 2013 normalization of relations between Serbia and Kosovo is a good case in point: there was sufficient consensus among member states that Ashton was able to spearhead an agreement between the two countries, for which she deservedly earned credit.

If there is a lack of consensus but also an imbalance of interest among member states, ad hoc groups of interested member states tend to take the initiative -- as did the United Kingdom, France, and Germany in 2003 on Iran’s nuclear program and Poland and Lithuania during Ukraine’s 2004 Orange Revolution. The high representative’s task here is not to lead but to help devise a policy course acceptable to all member states and, once the policy has been created, lend it the political weight of the whole EU. Ashton has carefully interpreted this role in the nuclear talks with Iran, which she has conducted on behalf of the P5+1 (the five permanent members of the UN Security Council plus Germany).

Finally, when member states have conflicting interests and all care about a particular issue, as they often do with regard to Russia, the high representative is limited to proposing lowest-common-denominator options that, however unsatisfying, represent what the EU can reasonably do. Ukraine, for better or for worse, is an example in which it would serve the EU little for the high representative to try to lead the member states to a destination that they have not (at least yet) agreed they want to go.

The high representative’s job description thus includes policy shaping, consensus building, and conflict management skills. The measure of his or her success is less a function of foreign policy chops than of the interpersonal skills the representative brings to the job. Measured against these requirements, Ashton’s record is decent. By the same token, there might be less reason to worry about Mogherini than some expect.

Mogherini is the high representative that EU leaders want. She is a woman, she is from the center-left, and she compensates the Italians for their recent losses in the international ranking of influential countries. Perhaps most significant, thanks to her lack of experience and high profile, she is unlikely to be able to challenge the member states’ principal role in EU foreign policy. Attesting to this is the fact that a number of EU member states agreed to her appointment despite having expressed concerns about Italy’s tendency to seek accommodation with Russia at a moment when Russia is invading its neighbor. However unhappy these countries may be with Mogherini’s selection, they are confident that her personal opinion on Russia will not affect the EU’s consensus-based foreign-policy-making process.

Mogherini’s weaknesses are real, but if she concentrates on what the EU high representative can realistically do, she can turn them into strengths. Her lack of defined policy positions on most issues will allow her to reflect consensus when it exists and to rely on the EEAS, which Ashton so assiduously built, to implement policies. This might make her an effective bridge builder between member states that disagree and also allows her to be more supportive than someone with a more established profile when vanguard groups of interested states want to move forward on specific issues on their own. Her lack of gravitas is more an issue of relative inexperience than a lack of personality. If she interprets correctly the multitasking role of the high representative, her standing will grow accordingly, as has happened with Ashton. Even on Russia policy, Mogherini has a unique opportunity. Although EU members are divided on what to do, Russia’s escalating aggression in Ukraine is slowly bringing them together. As an Italian associated with a relatively pro-Russian stance, her eventual calls to confront the Kremlin could be all the more effective.

The EU and the United States need a more unified and effective European foreign policy. But the EU is what it is. A U.S.-style secretary of state with a strong vision and lust for the spotlight would not transform the union because he or she would lack the legal authority and political legitimacy to do so. But a good high representative can still move the EU in the right direction, as long as he or she understands the subtleties of the role. And with the support of skilled advisers from the EEAS, Mogherini can be the high representative the EU needs.

This piece was originally published in Foreign Affairs.

From Syria and Iraq to Libya and Yemen, the Middle East is once again rife with conflict. Much of the fighting is along sectarian lines, but can it really be explained simply as a “Sunni versus Shia” battle? What explains this upsurge in violence across the region? And what role can or should the United States play?

In a new Analysis Paper, F. Gregory Gause, III frames Middle East politics in terms of a new, regional cold war in which Iran and Saudi Arabia compete for power and influence. Rather than stemming from sectarian rivalry, this new Middle East cold war results from the weakening of Arab states and the creation of domestic political vacuums into which local actors invite external support.

Read "Beyond Sectarianism: The New Middle East Cold War"

Gause contends that military power is not as useful in the regional competition as transnational ideological and political connections that resonate with key domestic players. The best way to defuse the conflicts, he argues, is to reconstruct stable political orders that can limit external meddling.

Noting the limits in U.S. capacity to do so, Gause recommends that the United States take a modest approach focused on supporting the states that actually govern, acting multilaterally, and remembering that core U.S. interests have yet to be directly threatened.

Read the full paper in English or Arabic.

Downloads

• English PDF
• Arabic PDF

As part of his economic revitalization plan, Japan’s Prime Minister Shinzo Abe has been touting “womenomics,” a plan to increase the number of women in the labor force. One way for women to enter the workforce but bypass the conventional corporate structure is through entrepreneurship.

Four questions for three female entrepreneurs

At a recent Center for East Asia Policy Studies event on womenomics and female entrepreneurship in Japan, we brought together three successful female entrepreneurs to discuss their experiences both in the United States and Japan. Prior to their panel discussion, we asked each of the speakers four questions about their careers.

1. What was the trigger that made you decide to start your own business?
2. What was the biggest hurdle in starting and/or running your business?
3. How or when was being a woman an asset to you as an entrepreneur and/or running your business?
4. How has the climate for female entrepreneurs changed compared to when you started your business?

Despite the differing environments for entrepreneurs and working women in the two countries, the speakers raised many of the same issues and offered similar advice. Access to funding or financing was an issue in both countries, as was the necessity to overcome fears about running a business or being in male-dominated fields. All of the speakers noted the positive changes in the business environment for female entrepreneurs since they had started their own businesses, as well as the impact this has had in creating more opportunities for women.

Donna Fujimoto Cole

Donna Fujimoto Cole is the president and CEO of Cole Chemical and Distributing Inc. in Houston, Texas. She started her company in 1980 at the urging of her clients. Today Cole Chemical is ranked 131 among chemical distributors globally by ICIS (Independent Chemical Information Service) and its customers include Bayer Material Scientific, BP America, Chevron, ExxonMobil, Lockheed Martin, Procter & Gamble, Shell, Spectra Energy, and Toyota. Cole is also an active member of her community and serves on the boards of a variety of national and regional organizations.

Fujiyo Ishiguro

A founding member for the Netyear Group, Fujiyo Ishiguro is now the president and CEO of the Netyear Group Corporation based in Tokyo, Japan. The firm, which was established in 1999, devises comprehensive digital marketing solutions for corporate clients. The Netyear Group was listed on the Mothers section of the Tokyo Stock Exchange in 2008. Recently, Ishiguro has served on a number of Japanese government committees including the Cabinet Office’s “The Future to Choose” Committee and the Ministry of Economy, Trade and Industry’s “Internet of Things” Committee. 

Sachiko Kuno

Sachiko Kuno is the co-founder, president, and CEO of the S&R Foundation in Washington, D.C., a non-profit organization that supports talented individuals in the fields of science, art, and social entrepreneurship. A biochemist by training, Kuno and her research partner and husband Ryuji Ueno have established a number pharmaceutical companies and philanthropic foundations including R-Tech Ueno in Japan and Sucampo Pharmaceuticals in Bethesda, Maryland. Together, Kuno and Ueno hold over 900 patents. Kuno is active in the greater Washington community and serves on the boards of numerous regional organizations.

Full video of the event featuring these speakers can be found here.

Video

• The importance of mentors for female entrepreneurs
• Female entrepreneurs: Different options and different styles
• Female leadership creates opportunities

Abstract

Most pollsters base their election projections off questions of voter intentions, which ask “If the election were held today, who would you vote for?” By contrast, we probe the value of questions probing voters’ expectations, which typically ask: “Regardless of who you plan to vote for, who do you think will win the upcoming election?” We demonstrate that polls of voter expectations consistently yield more accurate forecasts than polls of voter intentions. A small-scale structural model reveals that this is because we are polling from a broader information set, and voters respond as if they had polled twenty of their friends. This model also provides a rational interpretation for why respondents’ forecasts are correlated with their expectations. We also show that we can use expectations polls to extract accurate election forecasts even from extremely skewed samples.

I. Introduction

Since the advent of scientific polling in the 1930s, political pollsters have asked people whom they intend to vote for; occasionally, they have also asked who they think will win. Our task in this paper is long overdue: we ask which of these questions yields more accurate forecasts. That is, we evaluate the predictive power of the questions probing voters’ intentions with questions probing their expectations. Judging by the attention paid by pollsters, the press, and campaigns, the conventional wisdom appears to be that polls of voters’ intentions are more accurate than polls of their expectations.

Yet there are good reasons to believe that asking about expectations yields more greater insight. Survey respondents may possess much more information about the upcoming political race than that probed by the voting intention question. At a minimum, they know their own current voting intention, so the information set feeding into their expectations will be at least as rich as that captured by the voting intention question. Beyond this, they may also have information about the current voting intentions—both the preferred candidate and probability of voting—of their friends and family. So too, they have some sense of the likelihood that today’s expressed intention will be changed before it ultimately becomes an election-day vote. Our research is motivated by idea that the richer information embedded in these expectations data may yield more accurate forecasts.

We find robust evidence that polls probing voters’ expectations yield more accurate predictions of election outcomes than the usual questions asking about who they intend to vote for. By comparing the performance of these two questions only when they are asked of the exact same people in exactly the same survey, we effectively difference out the influence of all other factors. Our primary dataset consists of all the state-level electoral presidential college races from 1952 to 2008, where both the intention and expectation question are asked. In the 77 cases in which the intention and expectation question predict different candidates, the expectation question picks the winner 60 times, while the intention question only picked the winner 17 times. That is, 78% of the time that these two approaches disagree, the expectation data was correct. We can also assess the relative accuracy of the two methods by assessing the extent to which each can be informative in forecasting the final vote share; we find that relying on voters’ expectations rather than their intentions yield substantial and statistically significant increases in forecasting accuracy. An optimally-weighted average puts over 90% weight on the expectations-based forecasts. Once one knows the results of a poll of voters expectations, there is very little additional information left in the usual polls of voting intentions. Our findings remain robust to correcting for an array of known biases in voter intentions data.

The better performance of forecasts based on asking voters about their expectations rather than their intentions, varies somewhat, depending on the specific context. The expectations question performs particularly well when: voters are embedded in heterogeneous (and thus, informative) social networks; when they don’t rely too much on common information; when small samples are involved (when the extra information elicited by asking about intentions counters the large sampling error in polls of intentions); and at a point in the electoral cycle when voters are sufficiently engaged as to know what their friends and family are thinking.

Our findings also speak to several existing strands of research within election forecasting. A literature has emerged documenting that prediction markets tend to yield more accurate forecasts than polls (Wolfers and Zitzewitz, 2004; Berg, Nelson and Rietz, 2008). More recently, Rothschild (2009) has updated these findings in light of the 2008 Presidential and Senate races, showing that forecasts based on prediction markets yielded systematically more accurate forecasts of the likelihood of Obama winning each state than did the forecasts based on aggregated intention polls compiled by Nate Silver for the website FiveThirtyEight.com. One hypothesis for this superior performance is that because prediction markets ask traders to bet on outcomes, they effectively ask a different question, eliciting the expectations rather than intentions of participants. If correct, this suggests that much of the accuracy of prediction markets could be obtained simply by polling voters on their expectations, rather than intentions.

These results also speak to the possibility of producing useful forecasts from non-representative samples (Robinson, 1937), an issue of renewed significance in the era of expensive-to-reach cellphones and cheap online survey panels. Surveys of voting intentions depend critically on being able to poll representative cross-sections of the electorate. By contrast, we find that surveys of voter expectations can still be quite accurate, even when drawn from non-representative samples. The logic of this claim comes from the difference between asking about expectations, which may not systematically differ across demographic groups, and asking about intentions, which clearly do. Again, the connection to prediction markets is useful, as Berg and Rietz (2006) show that prediction markets have yielded accurate forecasts, despite drawing from an unrepresentative pool of overwhelmingly white, male, highly educated, high income, self-selected traders.

While questions probing voters’ expectations have been virtually ignored by political forecasters, they have received some interest from psychologists. In particular, Granberg and Brent (1983) document wishful thinking, in which people’s expectation about the likely outcome is positively correlated with what they want to happen. Thus, people who intend to vote Republican are also more likely to predict a Republican victory. This same correlation is also consistent with voters preferring the candidate they think will win, as in bandwagon effects, or gaining utility from being optimistic. We re-interpret this correlation through a rational lens, in which the respondents know their own voting intention with certainty and have knowledge about the voting intentions of their friends and family.

Our alternative approach to political forecasting also provides a new narrative of the ebb and flow of campaigns, which should inform ongoing political science research about which events really matter. For instance, through the 2004 campaign, polls of voter intentions suggested a volatile electorate as George W. Bush and John Kerry swapped the lead several times. By contrast, polls of voters’ expectations consistently showed the Bush was expected to win re-election. Likewise in 2008, despite volatility in the polls of voters’ intentions, Obama was expected to win in all of the last 17 expectations polls taken over the final months of the campaign. And in the 2012 Republican primary, polls of voters intentions at different points showed Mitt Romney trailing Donald Trump, then Rick Perry, then Herman Cain, then Newt Gingrich and then Rick Santorum, while polls of expectations showed him consistently as the likely winner.

We believe that our findings provide tantalizing hints that similar methods could be useful in other forecasting domains. Market researchers ask variants of the voter intention question in an array of contexts, asking questions that elicit your preference for one product, over another. Likewise, indices of consumer confidence are partly based on the stated purchasing intentions of consumers, rather than their expectations about the purchase conditions for their community. The same insight that motivated our study—that people also have information on the plans of others—is also likely relevant in these other contexts. Thus, it seems plausible that survey research in many other domains may also benefit from paying greater attention to people’s expectations than to their intentions.

The rest of this paper proceeds as follows, In Section II, we describe our first cut of the data, illustrating the relative success of the two approaches to predicting the winner of elections. In Sections III and IV, we focus on evaluating their respective forecasts of the two-party vote share. Initially, in Section III we provide what we call naïve forecasts, which follow current practice by major pollsters; in Section IV we product statistically efficient forecasts, taking account of the insights of sophisticated modern political scientists. Section V provides out-of-sample forecasts based on the 2008 election. Section VI extends the assessment to a secondary data source which required substantial archival research to compile. In Section VII, we provide a small structural model which helps explain the higher degree of accuracy obtained from surveys of voter expectations. Section VIII characterizes the type of information that is reflected in voters’ expectation, arguing that it is largely idiosyncratic, rather than the sort of common information that might come from the mass media. Section IX assesses why it is that people’s expectations are correlated with their intentions. Section VI uses this model to show how we can obtain surprisingly accurate expectation-based forecasts with non-representative samples. We then conclude. To be clear about the structure of the argument: In the first part of the paper (through section IV) we simply present two alternative forecasting technologies and evaluate them, showing that expectations-based forecasts outperform those based on traditional intentions-based polls. We present these data without taking a strong position on why. But then in later sections we turn to trying to assess what explains this better performance. Because this assessment is model-based, our explanations are necessarily based on auxiliary assumptions (which we spell out).

Right now, we begin with our simplest and most transparent comparison of the forecasting ability of our two competing approaches.

Download the full paper » (PDF)

Downloads

• Forecasting Elections: Voter Intentions versus Expectations

Editor's Note: A new academic study by David Rothschild and Justin Wolfers concludes that poll questions about expectations—which ask people whom they think will win—have historically been better guides to the outcome of presidential elections than traditional questions about people’s preferences. David Leonhardt of The New York Times conducted an interview with Wolfers by e-mail, focusing on the implications of the study for current presidential polls.

David Leonhardt:In the article, I discussed only briefly the expectations polls about the 2012 race, and some of the Twitter feedback was eager for more. By my count, there have been five recent major polls asking people whom they expect to win — by ABC/Washington Post, Gallup, Politico/George Washington University, New York Times/CBS News, and the University of Connecticut. There is also sixth from Rand asking people the percentage chances they place on each candidate winning. How consistent are the polls?

Justin Wolfers: There’s a striking consistency in how people are responding to these polls. The most recent data are from the Gallup poll conducted Oct. 27-28, and they found 54 percent of adults expect Obama to win, versus 34 percent for Romney. Around the same time (Oct. 25-28), there was a comparable New York Times/CBS poll in which 51 percent of likely voters expect Obama to win, versus 34 percent for Romney.

But these results aren’t just stable across pollsters, they’ve also been quite stable over the past few weeks, even as the race appeared to tighten for a while. Politico and George Washington University ran a poll of likely voters on Oct. 22-25, finding 54 percent expect Obama to win, versus 36 percent for Romney. The University of Connecticut/Hartford Courant poll of likely voters got a somewhat higher share not venturing an answer, with 47 percent expecting Obama to win versus 33 percent for Romney. Finally, the ABC/Washington Post poll of registered voters run Oct. 10-13 found 56 percent expect Obama to win, compared to 35 percent for Romney.

I’m rather surprised by the similarities here – across time, across pollsters, across how they word the question, and across different survey populations (likely voters, registered voters, or adults) – but I suspect that is part of the nature of the question. You just don’t see the noise here that you see in the barrage of polls of voter intentions, which are extremely sensitive to all of these factors.

I always throw out the folks who don’t have an opinion, and count the proportions as a share of only those who have an opinion. By this measure, the proportion who expect Obama to win is: 61 percent (Gallup), 60 percent (The New York Times), 60 percent (Politico), 59 percent (Hartford Courant), 62 percent (ABC). The corresponding proportions who expect Romney to win are: 39 percent, 40 percent, 40 percent, 41 percent and 38 percent. Taking an average across all these polls: 60.3 percent expect Obama to win. Or if you prefer that I focus only on the freshest two polls, 60.7 percent expect him to win.

DL: The results do seem have tightened somewhat since the first debate, which Romney was widely seen to have won, right? Do the patterns — or lack of patterns — in the numbers help solve the issue of what most people are thinking of when they answer the expectation question: Private information (their friends’ voting plans, yard signs in their neighborhood, etc.) or public information (media coverage, speeches, etc.)?

JW: The results of the polls of voter intentions seem to have tightened a bit since the first debate. There’s an interesting school of thought in political science that basically says: voters are pretty predictable. But they don’t think too hard about how they’re going to vote until right before the election. So what happens is that public opinion through time just converges to where it “should” be. And viewed through this lens, the first debate was just an opportunity for people who really should always have been in Romney’s camp to figure out that they’re in Romney’s camp.

So why did the expectations polls move less sharply than intentions polls? One possibility is that your expectations are explicitly forward-looking, and perhaps people saw the race tightening as they saw that some of the support for Obama was a bit soft. Let me put this another way: There are two problems with how we usually ask folks how they plan to vote. First, the question captures the state of public opinion today, while the expectations question effectively asks you where you think public opinion is going. And second, polls typically demand a yes or no answer, when the reality may be that we know that our support is pretty weak, and it may change, or we aren’t even sure whether we’ll turn up to the polls. The virtue of asking about expectations is that you can think about each of your friends, and think not just about who they’re supporting today, but also whether they may change their minds in the future.

I worry that it sounds a bit like I haven’t answered your question, but that’s because I don’t have a super-sharp answer. If I had to summarize, it would be: expectations questions allow you to think about how the dynamics of the race may change, and so they are less sensitive to that change when it happens.

DL: Based on your research and the current polls, what does the expectations question suggest is the most likely outcome on Tuesday?

JW: If a majority expects Obama to win, then right there, it says that I’m forecasting an Obama victory.

But by how much? Here’s where it gets tricky. The fact that 60 percent of people think that Obama is going to win doesn’t mean that he’s going to win 60 percent of the votes. And it doesn’t mean that he’s a 60 percent chance to win. Rather, it simply says that given the information they have, 60 percent of people believe that Obama is going to win. Can we use this to say anything about his likely winning margin?

Yes. I’ll spare you the details of the calculation, but it says that if 60.3 percent of people expect Obama to beat Romney, then we can forecast that he’ll win about 52.5 percent of the two-party vote. That would be a solid win, though not as impressive as his seven-point win in 2008.

The proportion who expect Obama to win right now looks awfully similar to the proportion who expected George W. Bush to win in a Gallup Poll at a similar point in 2004. Ultimately Bush won 51.2 percent of the two-party vote.

Right now, Nate Silver is predicting that Obama will win 50.5 percent of the popular vote, and Romney 48.6 percent. As a share of the two-party vote, this says he’s forecasting Obama to win 51 percent of the vote. Now Silver’s approach aggregates responses from hundreds of thousands of survey respondents, while I have far fewer, so his estimate still deserves a lot of respect. I don’t want to overstate the confidence with which I’m stating my forecast. So let me put it this way: My approach says that it’s likely that Obama will outperform the forecasts of poll-based analysts like Silver.

DL: We’ll find out soon enough. Thanks.

Gary Burtless, a senior fellow in Economic Studies, explains new research on the growing longevity gap between high-income and low-income Americans, especially among the aged.

“Life expectancy difference of low income workers, middle income workers, and high income workers has been increasing over time,” Burtless says. “For people born in 1920 their life expectancy was not as long typically as the life expectancy of people who were born in 1940. But those gains between those two birth years were very unequally distributed if we compare people with low mid-career earnings and people with high mid-career earnings.” Burtless also discusses retirement trends among the educated and non-educated, income inequality among different age groups, and how these trends affect early or late retirement rates.

Also stay tuned for our regular economic update with David Wessel, who also looks at the new research and offers his thoughts on what it means for Social Security.

Show Notes

Later retirement, inequality and old age, and the growing gap in longevity between rich and poor

Disparity in Life Spans of the Rich and the Poor Is Growing

Subscribe to the Brookings Cafeteria on iTunes, listen on Stitcher, and send feedback email to BCP@Brookings.edu.

Researchers have long known that the rich live longer than the poor. Evidence now suggests that the life expectancy gap is increasing, at least here the United States, which raises troubling questions about the fairness of current efforts to protect Social Security.

There's nothing particularly mysterious about the life expectancy gap. People in ill health, who are at risk of dying relatively young, face limits on the kind and amount of work they can do. By contrast, the rich can afford to live in better and safer neighborhoods, can eat more nutritious diets and can obtain access to first-rate healthcare. People who have higher incomes, moreover, tend to have more schooling, which means they may also have better information about the benefits of exercise and good diet.

Although none of the above should come as a surprise, it's still disturbing that, just as income inequality is growing, so is life-span inequality. Over the last three decades, Americans with a high perch in the income distribution have enjoyed outsized gains.

Using two large-scale surveys, my Brookings colleagues and I calculated the average mid-career earnings of each interviewed family; then we estimated the statistical relationship between respondents' age at death and their incomes when they were in their 40s. We found a startling spreading out of mortality differences between older people at the top and bottom of the income distribution.

For example, we estimated that a woman who turned 50 in 1970 and whose mid-career income placed her in the bottom one-tenth of earners had a life expectancy of about 80.4. A woman born in the same year but with income in the top tenth of earners had a life expectancy of 84.1. The gap in life expectancy was about 3½ years. For women who reached age 50 two decades later, in 1990, we found no improvement at all in the life expectancy of low earners. Among women in the top tenth of earners, however, life expectancy rose 6.4 years, from 84.1 to 90.5. In those two decades, the gap in life expectancy between women in the bottom tenth and the top tenth of earners increased from a little over 3½ years to more than 10 years.

Our findings for men were similar. The gap in life expectancy between men in the bottom tenth and top tenth of the income distribution increased from 5 years to 12 years over the same two decades.

Rising longevity inequality has important implications for reforming Social Security. Currently, the program takes in too little money to pay for all benefits promised after 2030. A common proposal to eliminate the funding shortfall is to increase the full retirement age, currently 66. Increasing the age for full benefits by one year has the effect of lowering workers' monthly checks by 6% to 7.5%, depending on the age when a worker first claims a pension.

For affluent workers, any benefit cut will be partially offset by gains in life expectancy. Additional years of life after age 65 increase the number years these workers collect pensions. Workers at the bottom of the wage distribution, however, are not living much longer, so the percentage cut in their lifetime pensions will be about the same as the percentage reduction in their monthly benefit check.

Our results and other researchers' findings suggest that low-income workers have not shared in the improvements in life expectancy that have contributed to Social Security's funding problem.

It therefore seems unfair to preserve Social Security by cutting future benefits across the board. Any reform in the program to keep it affordable should make special provision to protect the benefits of low-wage workers.

Editor's note: This piece originally appeared in The Los Angeles Times.