A key objective of the United Nations Development Programme (UNDP) is to assist its member countries in meeting the Millennium Development Goals (MDGs). UNDP pursues this objective in various ways, including through analysis and advice to governments on the progress towards the MDGs (such as support for the preparation and monitoring Poverty Reduction Strategies, or PRSs, in poor countries), assistance for capacity building, and financial and technical support for the preparation and implementation of development programs.

The challenge of achieving the MDGs remains daunting in many countries, including Tajikistan. To do so will require that all development partners, i.e., the government, civil society, private business and donors, make every effort to scale up successful development interventions. Scaling up refers to “expanding, adapting and sustaining successful policies, programs and projects on different places and over time to reach a greater number of people.” Interventions that are successful as pilots but are not scaled up will create localized benefits for a small number of beneficiaries, but they will fail to contribute significantly to close the MDG gap.

This paper aims to assess whether and how well UNDP is supporting scaling up in its development programs in Tajikistan. While the principal purpose of this assessment was to assist the UNDP country program director and his team in Tajikistan in their scaling up efforts, it also contributes to the overall growing body of evidence on the scaling up of development interventions worldwide.

Downloads

• Download Full Paper

Editor's Note: The World Bank’s Independent Evaluation Group (IEG) recently published a self-evaluation of its activities. Besides representing current thinking among evaluation experts at the World Bank, it also more broadly reflects some of the strengths and gaps in the approaches that evaluators use to assess and learn from the performance of the international institutions with which they work. The old question “Quis custodet ipsos custodes?” – loosely translated as “Who evaluates the evaluators?” – remains as relevant as ever. Johannes Linn served as an external peer reviewer of the self-evaluation and provides a bird’s-eye view on the lessons learned.

An Overview of the World Bank’s IEG Self-Evaluation Report

In 2011 the World Bank’s Independent Evaluation Group (IEG) carried out and published a self-evaluation of its activities. The self-evaluation team was led by an internal manager, but involved a respected external evaluation expert as the principal author and also an external peer reviewer.

The IEG self-evaluation follows best professional practices as codified by the Evaluation Cooperation Group (ECG). This group brings together the evaluation offices of seven major multilateral financial institutions in joint efforts designed to enhance evaluation performance and cooperation among their evaluators. One can therefore infer that the approach and focus of the IEG self-evaluation is representative of a broader set of practices that are currently used by the evaluation community of international financial organizations.

At the outset the IEG report states that “IEG is the largest evaluation department among Evaluation Capacity Group (ECG) members and is held in high regard by the international evaluation community. Independent assessments of IEG’s role as an independent evaluation function for the Bank and IFC rated it above the evaluation functions in most other ECG members, international nongovernmental organizations, and transnational corporations and found that IEG follows good practice evaluation principles.”

The self-evaluation report generally confirms this positive assessment. For four out of six areas of its mandate IEG gives itself the second highest rating (“good”) out of six possible rating categories. This includes (a) the professional quality of its evaluations, (b) its reports on how the World Bank’s management follows up on IEG recommendations, (c) cooperation with other evaluation offices, and (d) assistance to borrowing countries in improving their own evaluation capacity. In the area of appraising the World Bank’s self-evaluation and risk management practices, the report offers the third highest rating (“satisfactory”), while it gives the third lowest rating (“modest”) for IEG’s impact on the Bank’s policies, strategies and operations. In addition the self-evaluation concludes that overall the performance of IEG has been “good” and that it operates independently, effectively and efficiently.

The report makes a number of recommendations for improvement, which are likely to be helpful, but have limited impact on its activities. They cover measures to further enhance the independence of IEG and the consistency of evaluation practices as applied across the World Bank Group’s branches – the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) –; to improve the design of evaluations and the engagement with Bank management upstream for greater impact; and monitoring the impact of recent organizational changes in IEG in terms of results achieved. The report also recommends that more be done to evaluate the Bank’s analytical work and that evaluations draw on comparative evidence.

Assessment

In terms of the parameters of self-evaluation set by the prevailing practice among the evaluators on international financial agencies, the IEG self-evaluation is accurate and helpful. From my own experience as an operational manager in the Bank whose activities were evaluated by IEG in years past, and as a user of IEG evaluations (and of evaluations of other international aid organizations) for my research on aid effectiveness, I concur that IEG is independent and effective in meeting its mandate as defined. Moreover, the self-evaluation produces useful quantitative evidence (including survey results, budget analysis, etc.) to corroborate qualitative judgments.

However, the self-evaluation suffers from a number of limitations in approach and gaps in focus, which are broadly representative of the practices prevalent among many of the evaluation offices of international aid agencies.

Approach of the IEG self-evaluation

The core of the self-evaluation report is about the evaluation process followed by IEG, with very little said about the substance of IEG’s evaluations. The following questions could have usefully been raised, but were not: do evaluations cover the right issues with the right intensity, such as growth and poverty; environmental, governance, and gender impacts; regional dimensions versus exclusive country or project focus; effectiveness in addressing the problems of fragile and conflict states; effectiveness in dealing with global public goods; sustainability and scaling up; etc. Therefore the report does not deal with the question of whether IEG effectively responds in its evaluations to the many important strategic debates and issues with which the development community is grappling.

Related to this limitation is the fact that the report assessed the quality of IEG’s mostly in terms of (a) whether its approach and processes meet certain standards established by the Evaluation Cooperation Group; and (b) how it is judged by stakeholders in response to a survey commissioned for this evaluation. Both these approaches are useful, but they do not have any basis in professional assessments of the quality of individual products. This is equivalent to IEG evaluating the World Bank’s projects on the quality of its processes (e.g., appraisal and supervision processes) and on the basis of stakeholder surveys, without evaluating individual products and their impacts.

Gaps in the Self-Evaluation and in Evaluation Practice

Careful reading of the report reveals six important gaps in the IEG self-evaluation, in the prevailing evaluation practice in the World Bank, and more generally in the way international financial organizations evaluate their own performance. The first three gaps relate to aspects of the evaluation approach used and the second three gaps relate to lack of focus in the self-evaluation on key internal organizational issues:

1. Impact Evaluations: The report notes that IEG carries out two to three impact evaluations per year, but it sidesteps the debate in the current evaluation literature and practice as to what extent the “gold standard” of randomized impact evaluation should occupy a much more central role. Given the importance of this debate and divergence of views, it would have been appropriate for the self-evaluation to assess IEG’s current practice of very limited use of randomized evaluations.

2. Evaluation of Scaling Up: The report does not address the question of to what extent current IEG practice not only assesses the performance of individual projects in terms of their outcomes and sustainability, but also in terms of whether the Bank has systematically built on its experience in specific projects to help scale up their impact through support for expansion or replication in follow-up operations or through effective hand-off to the government or other partners. In fact, currently IEG does not explicitly and systematically consider scaling up in its project and program evaluations. For example, in a recent IEG evaluation of World Bank funded municipal development projects (MDPs) , IEG found that the Bank has supported multiple MDPs in many countries over the years, but the evaluation did not address the obvious question whether the Bank systematically planned for the project sequence or built on its experience from prior projects in subsequent operations. While most other evaluation offices like IEG do not consider scaling up, some (in particular those of the International Fund for Agricultural Development and the United Nations Development Program) have started doing so in recent years.

3. Drawing on the Experience of and Benchmarking Against Other Institutions: The self-evaluation report does a good job in benchmarking IEG performance in a number of respects against that of other multilateral institutions. In the main text of the report it states that “IEG plans to develop guidelines for approach papers to ensure greater quality, in particular in drawing on comparative information from other sources and benchmarking against other institutions.” This is a welcome intention, but it is inadequately motivated in the rest of the report and not reflected in the Executive Summary. The reality is that IEG, like most multilateral evaluation offices, so far has not systematically drawn on the evaluations and relevant experience of other aid agencies in its evaluations of World Bank performance. This has severely limited the learning impact of the evaluations.

4. Bank Internal Policies, Management Processes and Incentives: IEG evaluations traditionally do not focus on how the Bank’s internal policies, management and incentives affect the quality of Bank engagement in countries. Therefore evaluations cannot offer any insights into whether and how Bank-internal operating modalities contribute to results. Two recent exceptions are notable exceptions. First, the IEG evaluation of the Bank’s approach to harmonization with other donors and alignment with country priorities assesses the incentives for staff to support harmonization and alignment. The evaluation concludes that there are insufficient incentives, a finding disputed by management. Second, is the evaluation of the Bank’s internal matrix management arrangements, which is currently under way. The self-evaluation notes that Bank management tried to quash the matrix evaluation on the grounds that it did not fall under the mandate of IEG. This is an unfortunate argument, since an assessment of the institutional reasons for the Bank’s performance is an essential component of any meaningful evaluation of Bank-supported programs. While making a good case for the specific instance of the matrix evaluation, the self-evaluation report shies away from a more general statement in support of engaging IEG on issues of Bank-internal policies, management processes and incentives. It is notable that IFAD’s Independent Office of Evaluation appears to be more aggressive in this regard: It currently is carrying out a full evaluation of IFAD’s internal efficiency and previous evaluations (e.g., an evaluation of innovation and scaling up) did not shy away from assessing internal institutional dimensions.

5. World Bank Governance: The IEG self-evaluation is even more restrictive in how it interprets its mandate regarding the evaluation of the World Bank’s governance structures and processes (including its approach to members’ voice and vote, the functioning of its board of directors, the selection of its senior management, etc.). It considers these topics beyond IEG’s mandate. This is unfortunate, since the way the Bank’s governance evolves will substantially affect its long-term legitimacy, effectiveness and viability as an international financial institution. Since IEG reports to the Bank’s board of directors, and many of the governance issues involve questions of the board’s composition, role and functioning, there is a valid question of how effectively IEG could carry out such an evaluation. However, it is notable that the IMF’s Independent Evaluation Office, which similarly reports to the IMF board of directors, published a full evaluation of the IMF’s governance in 2008, which effectively addressed many of the right questions.

6. Synergies between World Bank, IFC and MIGA: The self-evaluation report points out that the recent internal reorganization of IEG aimed to assure more effective and consistent evaluations across the three member branches of the World Bank Group. This is welcome, but the report does not assess how past evaluations addressed the question of whether the World Bank, IFC and MIGA effectively capitalized on the potential synergies among the three organizations. The recent evaluation of the World Bank Group’s response to the global economic crisis of 2008/9 provided parallel assessments of each agency’s performance, but did not address whether they work together effectively in maximizing their synergies. The reality is that the three organizations have deeply engrained institutional cultures and generally go their own ways rather than closely coordinating their activities on the ground. Future evaluations should explicitly consider whether the three effectively cooperate or not. While the World Bank is unique in the way it has organizationally separated its private sector and guarantee operations, other aid organizations also have problems of a lack of cooperation, coordination and synergy among different units within the agency. Therefore, the same comment also applies to their evaluation approaches.

Conclusions

Self-evaluations are valuable tools for performance assessment and IEG is to be congratulated for carrying out and publishing such an evaluation of its own activities. As for all self-evaluations, it should be seen as an input to an independent external evaluation, a decision that, for now, has apparently been postponed by the Bank’s board of directors.

IEG’s self-evaluation has many strengths and provides an overall positive assessment of IEG’s work. However, it does reflect some important limitations of analysis and of certain gaps in approach and coverage, which an independent external review should consider explicitly, and which IEG’s management should address. Since many of these issues also likely apply to most of the other evaluation approaches by other evaluation offices, the lessons have relevance beyond IEG and the World Bank.

Key lessons include:

• An evaluation of evaluations should focus not only on process, but also on the substantive issues that the institution is grappling with.
• An evaluation of the effectiveness of evaluations should include a professional assessment of the quality of evaluation products.
• An evaluation of evaluations should assess:
  o How effectively impact evaluations are used;
  o How scaling up of successful interventions is treated;
  o How the experience of other comparable institutions is utilized;
  o Whether and how the internal policies, management practices and incentives of the institution are effectively assessed;
  o Whether and how the governance of the institution is evaluated; and
  o Whether and how internal coordination, cooperation and synergy among units within the organizations are assessed.

Evaluations play an essential role in the accountability and learning of international aid organizations. Hence it is critical that evaluations address the right issues and use appropriate techniques. If the lessons above were reflected in the evaluation practices of the aid institutions, this would represent a significant step forward in the quality, relevance and likely impact of evaluations.

Editor's Note: The "Scaling up in Agriculture, Rural Development and Nutrition" publication is a series of 20 briefs published by the International Food Policy Research Institute. To read the full publication, click here.

Taking successful development interventions to scale is critical if the world is to achieve the Millennium Development Goals and make essential gains in the fight for improved agricultural productivity, rural incomes, and nutrition. How to support scaling up in these three areas, however, is a major challenge. This collection of policy briefs is designed to contribute to a better understanding of the experience to date and the lessons for the future.

Scaling up means expanding, replicating, adapting, and sustaining successful policies, programs, or projects to reach a greater number of people; it is part of a broader process of innovation and learning. A new idea, model, or approach is typically embodied in a pilot project of limited impact; with monitoring and evaluation, the knowledge acquired from the pilot experience can be used to scale up the model to create larger impacts. The process generally occurs in an iterative and interactive cycle, as the experience from scaling up feeds back into new ideas and learning.

The authors of the 20 policy briefs included here explore the experience of scaling up successful interventions in agriculture, rural development, and nutrition under five broad headings: (1) the role of rural community engagement, (2) the importance of value chains, (3) the intricacies of scaling up nutrition interventions, (4) the lessons learned from institutional approaches, and (5) the experience of international aid donors.

There is no blueprint for when and how to take an intervention to scale, but the examples and experiences described in this series of policy briefs offer important insights into how to address the key global issues of agricultural productivity, food insecurity, and rural poverty.

Downloads

• Sample Chapter
• Table of Contents

• {9ABF977A-E4A6-41C8-B030-0FD655E07DBF}, 978-0-8157-2419-3, $29.95 Add to Cart

Editor's Note: Johannes Linn discusses the potential of multilateral development banks in the latest G-20 Research Group briefing book on the St. Petersburg G-20 Summit. Read the full collection here.

The origins of the multilateral development banks (MDBs) lie with the creation of the World Bank at Bretton Woods in 1944. Its initial purpose, as the International Bank for Reconstruction and Development, was the reconstruction of wartorn countries after the Second World War. 

As Europe and Japan recovered in the 1950s, the World Bank turned to providing financial assistance to the developing world. Then came the foundation of the InterAmerican Development Bank (IADB) in 1959, of the African Development Bank (AfDB) in 1964 and of the Asian Development Bank (ADB) in 1966, each to assist the development of countries in their respective regions. The European Bank for Reconstruction and Development (EBRD) was set up in 1991, following the collapse of the Soviet Union, to assist with the transition of countries in the former Soviet sphere. 

The MDBs are thus rooted in two key aspects of the geopolitical reality of the postwar 20th century: the Cold War between capitalist ‘West’ and communist ‘East’, and the division of the world into the industrial ‘North’ and the developing ‘South’. The former aspect was mirrored in the MDBs for many years by the absence of countries from the Eastern Bloc. This was only remedied after the fall of the Bamboo and Iron curtains. The latter aspect remains deeply embedded even today in the mandate, financing pattern and governance structures of the MDBs. 

Changing global financial architecture 

From the 1950s to the 1990s, the international financial architecture consisted of only three pillars: the International Monetary Fund (IMF) and the MDBs represented the multilateral official pillar; the aid agencies of the industrial countries represented bilateral official pillar; and the commercial banks and investors from industrial countries made up the private pillar. 

Today, the picture is dramatically different. Private commercial flows vastly exceed official flows, except during global financial crises. New channels of development assistance have multiplied, as foundations and religious and non-governmental organisations rival the official assistance flows in size. 

The multilateral assistance architecture, previously dominated by the MDBs, is now a maze of multilateral development agencies, with a slew of sub-regional development banks, some exceeding the traditional MDBs in size. For example, the European Investment Bank lends more than the World Bank, and the Caja Andina de Fomento (CAF, the Latin American Development Bank) more than the IADB. There are also a number of large ‘vertical funds’ for specific purposes, such as the International Fund for Agricultural Development and the Global Fund to Fight AIDS, Tuberculosis and Malaria. There are  specialized trust funds, attached to MDBs, but often with their own governance structures.

End of the North-South divide 

Finally, the traditional North-South divide is breaking down, as emerging markets have started to close the development gap, as global poverty has dropped and as many developing countries have large domestic capacities. This means that the new power houses in the South need little financial and technical assistance and are now providing official financial and technical support to their less fortunate neighbors. China’s assistance to Africa outstrips that of the World Bank.

The future for MDBs 

In this changed environment is there a future for MDBs? Three options might be considered: 

1. Do away with the MDBs as a relic of the past. Some more radical market ideologues might argue that, if there ever was a justification for the MDBs, that time is now well past. In 2000, a US congressional commission recommended the less radical solution of shifting the World Bank’s loan business to the regional MDBs. Even if shutting down MDBs were the right option, it is highly unlikely to happen. No multilateral financial institution created after the Second World War has ever been closed. Indeed, recently the Nordic Development Fund was to be shut down, but its owners reversed their decision and it will carry on, albeit with a focus on climate change. 

2. Carry on with business as usual. Currently, MDBs are on a track that, if continued, would mean a weakened mandate, loss of clients, hollowed-out financial strength and diluted technical capacity. Given their tight focus on the fight against poverty, the MDBs will work themselves out of a job as global poverty, according to traditional metrics, is on a dramatic downward trend. 

Many middle-income country borrowers are drifting away from the MDBs, since they find other sources of finance and technical advice more attractive. These include the sub-regional development banks, which are more nimble in disbursing their loans and whose governance is not dominated by the industrial countries. These countries, now facing major long-term budget constraints, will be unable to continue supporting the growth of the MDBs’ capital base. But they are also unwilling to let the emerging market economies provide relatively more funding and acquire a greater voice in these institutions.

Finally, while the MDBs retain professional staff that represents a valuable global asset, their technical strength relative to other sources of advice – and by some measures, even their absolute strength – has been waning. 

If left unattended, this would mean that MDBs 10 years from now, while still limping along, are likely to have lost their ability to provide effective financial and technical services on a scale and with a quality that matter globally or regionally. 

3. Give the MDBs a new mandate, new governance and new financing. If one starts from the proposition that a globalised 21st-century world needs capable global institutions that can provide long-term finance to meet critical physical and social infrastructure needs regionally and globally, and that can serve as critical knowledge hubs in an increasingly interconnected world, then it would be folly to let the currently still considerable institutional and financial strengths of the MDBs wither away.

• The mandate of the MDBs should be adapted to move beyond preoccupation with poverty eradication to focus explicitly on global and regional public goods as a way to help sustain global economic growth and human welfare. Moreover, the MDBs should be able to provide assistance to all their members, not only developing country members. 

• The governance of the MDBs should be changed to give the South a voice commensurate with the greater global role it now plays in economic and political terms. MDB leaders should be selected on merit without consideration of nationality. 

• The financing structure should be matched to give more space to capital contributions from the South and to significantly expand the MDBs’ capital resources in the face of the current severe capital constraints.

In addition, MDB management should be guided by banks’ membership to streamline their operational practices in line with those widely used by sub-regional development banks, and they should be supported in preserving and, where possible, strengthening their professional capacity so that they can serve as international knowledge hubs. 

A new MDB agenda for the G20 

The G20 has taken on a vast development agenda. This is fine, but it risks getting bogged down in the minutiae of development policy design and implementation that go far beyond what global leaders can and should deal with. What is missing is a serious preoccupation of the G20 with that issue on which it is uniquely well equipped to lead: reform of the global financial institutional architecture. 

What better place than to start with than the MDBs? The G20 should review the trends, strengths and weaknesses of MDBs in recent decades and endeavour to create new mandates, governance and financing structures that make them serve as effective pillars of the global institutional system in the 21st century. If done correctly, this would also mean no more need for new institutions, such as the BRICS development bank currently being created by Brazil, Russia, India, China and South Africa. It would be far better to fix the existing institutions than to create new ones that mostly add to the already overwhelming fragmentation of the global institutional system.

Event Information

The year 2015 will be a milestone year, with the adoption of the Sustainable Development Goals (SDGs) and the post-2015 development agenda by world leaders in September; the Addis Ababa Accord on financing for development in July; and the conclusion of climate negotiations at COP21 in Paris in December. The draft Addis Ababa Accord, which focuses on the actions needed to attain the SDGs, highlights the key role envisaged for the multilateral development banks (MDBs) in the post-2015 agenda. Paragraph 65 of the draft accord notes: “We call on the international finance institutions to establish a process to examine the role, scale, and functioning of the multilateral and regional development finance institutions to make them more responsive to the sustainable development agenda.”          

Against this backdrop, on April 18, 2015, the Global Economy and Development program at Brookings held a private roundtable with the leaders of the MDBs and other key stakeholders to discuss the role of the MDBs in supporting the post-2015 development agenda.

The meeting focused on four questions:

1. What does the post-2015 development agenda and the ambitions of the Addis and Paris conferences imply for the MDBs?


Given the ability of the MDBs to leverage shareholder resources, they can be efficient and effective mechanisms for scaling up development cooperation, particularly with respect to the agenda on investing in people and to the financing of sustainable infrastructure. New roles, instruments and partnerships might be needed.

2. How can MDBs best take advantage of the political attention that is being paid to the various conferences in 2015?   


The World Bank and selected regional development banks have launched a series of initiatives to optimize their balance sheets, address other constraints and enhance their catalytic role in crowding in private finance. And new institutions and mechanisms are coming to the fore. But the responses are not coordinated to best take advantage of each MDB’s comparative advantage.

3. What are the key impediments to scaling up the role and engagement of the MDBs?


Views on constraints are likely to differ but discussions should cover policy dialogue, capacity building, capital, leverage, shareholder backing on volume, instruments on leverage and risk mitigation, safeguards, and governance. 

4. How should the MDBs respond to the proposal to establish a process to examine the role, scale and functioning of the multilateral and regional development finance institutions to make them more responsive to the sustainable development agenda?   


A proactive response and engagement on the part of the MDBs would facilitate a better understanding of the contribution that the MDBs can make and greater support among shareholders for a coherent and stepped-up role.

Event Materials

• Participant List
• MDB PostEvent Summary

The replenishment process for concessional resources of the multilateral development banks is broken. We have come to this conclusion after a review of the experience with recent replenishments of multilateral development funds. We also base it on first-hand observation, since one of us was responsible for the World Bank’s International Development Association (IDA) replenishment consultations 20 years ago and recently served as the external chair for the last two replenishment consultations of the International Fund for Agricultural Development (IFAD), which closely follow the common multilateral development bank (MDB) practice. As many of the banks and their donors are preparing for midterm reviews as a first step toward the next round of replenishment consultations, this is a good time to take stock and consider what needs to be done to fix the replenishment process.

So what’s the problem?

Most of all, the replenishment process does not serve its key intended function of setting overall operational strategy for the development funds and holding the institutions accountable for effectively implementing the strategy. Instead, the replenishment consultations have turned into a time-consuming and costly process in which donor representatives from their capitals get bogged down in the minutiae of institutional management that are better left to the boards of directors and the managements of the MDBs. There are other problems, including lack of adequate engagement of recipient countries in donors’ deliberations, the lack of full participation of the donors’ representatives on the boards of the institutions in the process, and inflexible governance structures that serve as a disincentive for non-traditional donors (from emerging countries and from private foundations) to contribute.

But let’s focus on the consultation process. What does it look like? Typically, donor representatives from capitals assemble every three years (or four, in the case of the Asian Development Bank) for a year-long consultation round, consisting of four two-day meetings (including the meeting devoted to the midterm review of the ongoing replenishment and to setting the agenda for the next consultation process). For these meetings, MDB staff prepare, per consultation round, some 20 substantive documents that are intended to delve into operational and institutional performance in great detail. Each consultation round produces a long list of specific commitments (around 40 commitments is not uncommon), which management is required to implement and monitor, and report on in the midterm review. In effect, however, this review covers only half the replenishment cycle, which leads to the reporting, monitoring, and accountability being limited to the delivery of committed outputs (e.g., a specific sector strategy) with little attention paid to implementation, let alone outcomes.

The process is eerily reminiscent of the much maligned “Christmas tree” approach of the World Bank’s structural adjustment loans in the 1980s and 1990s, with their detailed matrixes of conditionality; lack of strategic selectivity and country ownership; focus on inputs rather than outcomes; and lack of consideration of the borrowers’ capacity and costs of implementing the Bank-imposed measures. Ironically, the donors successfully pushed the MDBs to give up on such conditionality (without ownership of the recipient countries) in their loans, but they impose the same kind of conditionality (without full ownership of the recipient countries and institutions) on the MDBs themselves—replenishment after replenishment.

Aside from lack of selectivity, strategic focus, and ownership of the commitments, the consultation process is also burdensome and costly in terms of the MDBs’ senior management and staff time as well as time spent by ministerial staff in donor capitals, with literally thousands of management and staff hours spent on producing and reviewing documentation. And the recent innovation of having donor representatives meet between consultation rounds as working groups dealing with long-term strategic issues, while welcome in principle, has imposed further costs on the MDBs and capitals in terms of preparing documentation and meetings.

It doesn’t have to be that way. Twenty years ago the process was much simpler and less costly. Even today, recent MDB capital increases, which mobilized resources for the non-concessional windows of the MDBs, were achieved with much simpler processes, and the replenishment consultations for special purpose funds, such as the Global Fund for HIV/AIDS, tuberculosis, and malaria and for the GAVI Alliance, are more streamlined than those of the MDBs.

So what’s to be done?

We recommend the following measures to fix the replenishment consultation process:

1. Focus on a few strategic issues and reduce the number of commitments with an explicit consideration of the costs and capacity requirements they imply. Shift the balance of monitoring and accountability from delivery of outputs to implementation and outcomes.
2. Prepare no more than five documents for the consultation process: (i) a midterm review on the implementation of the previous replenishment and key issues for the future; (ii) a corporate strategy or strategy update; (iii) the substantive report on how the replenishment resources will contribute to achieve the strategy; (iv) a financial outlook and strategy document; and (v) the legal document of the replenishment resolution.
3. Reduce the number of meetings for each replenishment round to no more than three and lengthen the replenishment period from three to four years or more.
4. Use the newly established working group meetings between replenishment consultation rounds to focus on one or two long-term, strategic issues, including how to fix the replenishment process.

The initiative for such changes lies with the donor representatives in the capitals, and from our interviews with donor representatives we understand that many of them broadly share our concerns. So this is a good time—indeed it is high time!—for them to act.

Event Information

In 2015, 193 countries adopted the Sustainable Development Goals (SDGs), a new global agenda that is more ambitious than the preceding Millennium Development Goals and aims to make progress on some of the most pressing issues of our time. Goal 4, "To ensure inclusive and quality education for all, with relevant and effective learning outcomes," challenges the international education community to meet universal access plus learning by 2030. We know that access to primary schooling has scaled up rapidly over previous decades, but what can be learned from places where transformational changes in learning have occurred? What can governments, civil society, and the private sector do to more actively scale up quality learning?

On April 18-19, the Center for Universal Education (CUE) at Brookings launched "Millions Learning: Scaling Up Quality Education in Developing Countries," a comprehensive study that examines where learning has improved around the world and what factors have contributed to that process. This two-day event included two sessions. Monday, April 18 focused on the role of global actors in accelerating progress to meeting the SDGs. The second session on Tuesday, April 19 included a presentation of the Millions Learning report followed by panel discussions on the role of financing and technology in scaling education in developing countries.

 Join the conversation on Twitter #MillionsLearning

Video

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?
• Scaling quality education: The launch of the Millions Learning report
• Do funders help or hinder scaling in education?
• What role can technology play in scaling education?

Audio

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?

Transcript

• Uncorrected Transcript - Day 1 (.pdf)
• Uncorrected Transcript - Day 2 (.pdf)

Event Materials

• 20160418_millions_learning_transcript
• 20160419_millions_learning_transcript

To achieve the desired outcomes of the Sustainable Development Goals as well as the global targets from the Paris COP21 Climate Summit by 2030, governments will have to find ways to meet the top-down objectives with bottom-up approaches. A systematic focus on scaling up successful development interventions could serve to bridge this gap, or what’s been called the “missing middle.” However, the question remains how to actually address the challenge of scaling up.

When Arna Hartmann, adjunct professor of international development, and I first looked at the scaling up agenda in development work in the mid-2000s, we concluded that development agencies were insufficiently focused on supporting the scaling up of successful development interventions. The pervasive focus on one-off projects all too often resulted in what I’ve come to refer to as “pilots to nowhere.” As a first step to fix this, we recommended that each aid organization carry out a review to be sure to focus effectively on scaling up. 

The institutional dimension is critical, given their role in developing and implementing scaling up pathways. Of course, individuals serve as champions, designers, and implementers, but experience illustrates that if individuals lack a strong link to a supportive institution, scaling up is most likely to be short-lived and unsustainable. “Institutions” include many different types of organizations, such as government ministries and departments, private firms and social enterprises, civil society organizations, and both public and private external donors and financiers.

The Brookings book “Getting to Scale: How to Bring Development Solutions to Millions of Poor People” explores the opportunities and challenges that such organizations face, on their own or, better yet, partnering with each other, in scaling up the development impact of their successful interventions.

Over the past decade I have worked with 10 foreign aid institutions—multilateral and bilateral agencies, as well as big global non-governmental organizations—helping them to focus systematically on scaling up operational work and developing approaches to do so. There are common lessons that apply across the board to these agencies, with one salutary example being the International Fund for Agricultural Development (IFAD) which has tackled the scaling up agenda systematically and persistently.

Following are eight takeaway lessons I gleaned from my work with IFAD:

1. Look into the “black box” of institutions. It is not enough to decide that an institution should focus on and support scaling up of successful development interventions. You actually need to look at how institutions function in terms of their mission statement and corporate strategy, their policies and processes, their operational instruments, their budgets, management and staff incentives, and their monitoring and evaluation practices. Check out the Brookings working paper that summarizes the results of a scaling up review of the IFAD.
2. Scaling needs to be pursued institution-wide. Tasking one unit in an organization with innovation and scaling up, or creating special outside entities (like the Global Innovation Fund set up jointly by a number of donor agencies) is a good first step. But ultimately, a comprehensive approach must be mainstreamed so that all operational activities are geared toward scaling up.
3. Scaling up must be championed from the top. The governing boards and leadership of the institutions need to commit to scaling up and persistently stay on message, since, like any fundamental institutional change, effectively scaling up takes time, perhaps a decade or more as with IFAD.
4. The scaling up process must be grown within the institution. External analysis and advice from consultants can play an important role in institutional reviews. But for lasting institutional change, the leadership must come from within and involve broad participation from managers and staff in developing operational policies and processes that are tailored to an institution’s specific culture, tasks, and organizational structure.
5. A well-articulated operational approach for scaling up needs to be put in place. For more on this, take a look at a recent paper by Larry Cooley and I that reviews two helpful operational approaches, which are also covered in Cooley’s blog. For the education sector, the Center for Universal Education at Brookings just published its report “Millions Learning,” which provides a useful scaling up approach specifically tailored to the education sector.
6. Operational staffs need to receive practical guidance and training. It is not enough to tell staff that they have to focus on scaling up and then give them a general framework. They also need practical guidance and training, ideally tailored to the specific business lines they are engaged in. IFAD, for example, developed overall operational guidelines for scaling up, as well as guidance notes for specific area of engagement, including livestock development, agricultural value chains, land tenure security, etc.  This guidance and training ideally should also be extended to consultants working with the agency on project preparation, implementation, and evaluation, as well as to the agency’s local counterpart organizations.
7. New approaches to monitoring and evaluation (M&E) have to be crafted. Typically the M&E for development projects is backward looking and focused on accountability, narrow issues of implementation, and short-term results. Scaling up requires continuous learning, structured experimentation, and innovation based on evidence, including whether the enabling conditions for scaling up are being established. And it is important to monitor and evaluate the institutional mainstreaming process of scaling up to ensure that it is effectively pursued. I’d recommend looking at how the German Agency for International Development (GIZ) carried out a corporate-wide evaluation of its scaling up experience.
8. Scaling up helps aid organizations mobilize financial resources. Scaling up leverages limited institutional resources in two ways: First, an organization can multiply the impact of its own financial capacity by linking up with public and private agencies and building multi-stakeholder coalitions in support of scaling up. Second, when an organization demonstrates that it is pursuing not only one-off results but also scaled up impact, funders or shareholders of the organization tend to be more motivated to support the organization. This certainly was one of the drivers of IFAD’s successful financial replenishment consultation rounds over the last decade.

By adopting these lessons, development organizations can actually begin to scale up to the level necessary to bridge the missing middle. The key will be to assure that a focus on scaling up is not the exception but instead becomes ingrained in the institutional DNA. Simply put, in designing and implementing development programs and projects, the question needs to be answered, “What’s next, if this intervention works?”

Last Thursday was finance minister day at Brookings, with three separate visits from European finance ministers who were in town for the IMF meetings. Here in Governance Studies, we were delighted to have the opportunity to host Czech Finance Minister and Deputy Prime Minister Andrej Babis for a wide-ranging conversation with our scholars, including Darrell West, Bill Galston, John Hudak, and myself, as well as Bill Drozdiak of Brookings' Center on the United States and Europe and Jeff Gedmin of Georgetown University. Brookings has a long tradition of welcoming distinguished European visitors, and so contributing to the strengthening of transatlantic ties. That is particularly important now, as Europe confronts the destabilizing effects of Russia's aggression in Ukraine, the Greek debt crisis, be continuing after effects of the great recession, and multiple other challenges. We were honored to host Minister Babis and we look forward to many more visits here from leaders of our close U.S. ally, the Czech Republic.

(Photo credit: Embassy of the Czech Republic)

One of the great parts of being at Brookings has been the many champions of government reform in the US and around the world who have reached out to visit us here, meet me and my colleagues, and talk about how best to transform government and make it work better for people. The latest was MK Erel Margalit, who before joining the Israeli Knesset started a leading venture capital firm in Israel (and was the first Israeli to make the Forbes Midas list of top tech investors globally). My Brookings colleagues, including Elaine Kamarck, Bill Galston, Natan Sachs and John Hudak talked with MK Margalit about the lessons he learned in the private sector, and about his efforts to bring those lessons to his work in government. 

Coming not long after our meeting with Czech Deputy Prime Minister and Finance Minister Andre Babis, who enjoyed similar success in business and has ambitious reform goals of his own informed by his business career, it was fascinating to talk about what does and does not translate to the government sector. MK Margalit’s focus includes supporting peace and economic development by developing enterprise zones in and around Israel that encourage economic partnerships between Jewish and Arab Israelis and their businesses, and that include Palestinians as well. It was an impressive melding of business and government methodologies. The meeting built on similar ones we have had with other innovators including CFPB Director Rich Cordray, former Mayor and Governor Martin O’Malley, and of course DPM Babis, all of whom have in common innovating to make government function more effectively.

Editor's Note: The introduction to the 2015 Brown Center Report on American Education appears below. Use the Table of Contents to navigate through the report online, or download a PDF of the full report.

TABLE OF CONTENTS

Part I: Girls, Boys, and Reading

Part II: Measuring Effects of the Common Core

Part III: Student Engagement

INTRODUCTION

The 2015 Brown Center Report (BCR) represents the 14^th edition of the series since the first issue was published in 2000.  It includes three studies.  Like all previous BCRs, the studies explore independent topics but share two characteristics: they are empirical and based on the best evidence available.  The studies in this edition are on the gender gap in reading, the impact of the Common Core State Standards -- English Language Arts on reading achievement, and student engagement.

Part one examines the gender gap in reading.  Girls outscore boys on practically every reading test given to a large population.  And they have for a long time.  A 1942 Iowa study found girls performing better than boys on tests of reading comprehension, vocabulary, and basic language skills.  Girls have outscored boys on every reading test ever given by the National Assessment of Educational Progress (NAEP)—the first long term trend test was administered in 1971—at ages nine, 13, and 17.  The gap is not confined to the U.S.  Reading tests administered as part of the Progress in International Reading Literacy Study (PIRLS) and the Program for International Student Assessment (PISA) reveal that the gender gap is a worldwide phenomenon.  In more than sixty countries participating in the two assessments, girls are better readers than boys. 

Perhaps the most surprising finding is that Finland, celebrated for its extraordinary performance on PISA for over a decade, can take pride in its high standing on the PISA reading test solely because of the performance of that nation’s young women.  With its 62 point gap, Finland has the largest gender gap of any PISA participant, with girls scoring 556 and boys scoring 494 points (the OECD average is 496, with a standard deviation of 94).   If Finland were only a nation of young men, its PISA ranking would be mediocre.

Part two is about reading achievement, too. More specifically, it’s about reading and the English Language Arts standards of the Common Core (CCSS-ELA).  It’s also about an important decision that policy analysts must make when evaluating public policies—the determination of when a policy begins. How can CCSS be properly evaluated? 

Two different indexes of CCSS-ELA implementation are presented, one based on 2011 data and the other on data collected in 2013.  In both years, state education officials were surveyed about their Common Core implementation efforts.  Because forty-six states originally signed on to the CCSS-ELA—and with at least forty still on track for full implementation by 2016—little variability exists among the states in terms of standards policy.  Of course, the four states that never adopted CCSS-ELA can serve as a small control group.  But variation is also found in how the states are implementing CCSS.  Some states are pursuing an array of activities and aiming for full implementation earlier rather than later.  Others have a narrow, targeted implementation strategy and are proceeding more slowly. 

The analysis investigates whether CCSS-ELA implementation is related to 2009-2013 gains on the fourth grade NAEP reading test.  The analysis cannot verify causal relationships between the two variables, only correlations.  States that have aggressively implemented CCSS-ELA (referred to as “strong” implementers in the study) evidence a one to one and one-half point larger gain on the NAEP scale compared to non-adopters of the standards.  This association is similar in magnitude to an advantage found in a study of eighth grade math achievement in last year’s BCR.  Although positive, these effects are quite small.  When the 2015 NAEP results are released this winter, it will be important for the fate of the Common Core project to see if strong implementers of the CCSS-ELA can maintain their momentum.

Part three is on student engagement.  PISA tests fifteen-year-olds on three subjects—reading, math, and science—every three years.  It also collects a wealth of background information from students, including their attitudes toward school and learning.  When the 2012 PISA results were released, PISA analysts published an accompanying volume, Ready to Learn: Students’ Engagement, Drive, and Self-Beliefs, exploring topics related to student engagement.

Part three provides secondary analysis of several dimensions of engagement found in the PISA report.  Intrinsic motivation, the internal rewards that encourage students to learn, is an important component of student engagement.  National scores on PISA’s index of intrinsic motivation to learn mathematics are compared to national PISA math scores.  Surprisingly, the relationship is negative.  Countries with highly motivated kids tend to score lower on the math test; conversely, higher-scoring nations tend to have less-motivated kids. 

The same is true for responses to the statements, “I do mathematics because I enjoy it,” and “I look forward to my mathematics lessons.”  Countries with students who say that they enjoy math or look forward to their math lessons tend to score lower on the PISA math test compared to countries where students respond negatively to the statements.  These counterintuitive finding may be influenced by how terms such as “enjoy” and “looking forward” are interpreted in different cultures.  Within-country analyses address that problem.  The correlation coefficients for within-country, student-level associations of achievement and other components of engagement run in the anticipated direction—they are positive.  But they are also modest in size, with correlation coefficients of 0.20 or less. 

Policymakers are interested in questions requiring analysis of aggregated data—at the national level, that means between-country data.  When countries increase their students’ intrinsic motivation to learn math, is there a concomitant increase in PISA math scores?  Data from 2003 to 2012 are examined.  Seventeen countries managed to increase student motivation, but their PISA math scores fell an average of 3.7 scale score points.  Fourteen countries showed no change on the index of intrinsic motivation—and their PISA scores also evidenced little change.  Eight countries witnessed a decline in intrinsic motivation.  Inexplicably, their PISA math scores increased by an average of 10.3 scale score points.  Motivation down, achievement up.

Correlation is not causation.  Moreover, the absence of a positive correlation—or in this case, the presence of a negative correlation—is not refutation of a possible positive relationship.  The lesson here is not that policymakers should adopt the most effective way of stamping out student motivation.  The lesson is that the level of analysis matters when analyzing achievement data.  Policy reports must be read warily—especially those freely offering policy recommendations.  Beware of analyses that exclusively rely on within- or between-country test data without making any attempt to reconcile discrepancies at other levels of analysis.  Those analysts could be cherry-picking the data.  Also, consumers of education research should grant more credence to approaches modeling change over time (as in difference in difference models) than to cross-sectional analyses that only explore statistical relationships at a single point in time. 

Downloads

• Download the report

Tom Loveless, a nonresident senior fellow in Governance Studies, explains his latest research on measuring achievement of American students.

“The bottom line here: the implementation of the common core has appeared to have very little impact on student achievement,” Loveless says. In this episode, he discusses whether the common core is failing our students, whether AP achievement is indicative of student success, and the role of principals as instructional leaders.

Also in this episode: Get to know Constanze Stelzenmüller, the Robert Bosch Senior Fellow in the Center on the United States and Europe, during our "Coffee Break” segment. Also stay tuned to hear the final episode in our centenary series with current and past Brookings scholars.

Show Notes:

The Brown Center Report on American Education

Brookings Centenary Timeline

Subscribe to the Brookings Cafeteria on iTunes, listen in all the usual places, and send feedback email to BCP@Brookings.edu.

The eurozone has three problems: national debt obligations that cannot be met, medium-term imbalances in trade competitiveness, and long-term structural flaws.

The short-run problem requires more of the monetary easing that Germany has, with appalling shortsightedness, been resisting, and less of the near-term fiscal restraint that Germany has, with equally appalling shortsightedness, been seeking. To insist that Greece meet all of its near-term current debt service obligations makes about as much sense as did French and British insistence that Germany honor its reparations obligations after World War I. The latter could not be and were not honored. The former cannot and will not be honored either.

The medium-term problem is that, given a single currency, labor costs are too high in Greece and too low in Germany and some other northern European countries. Because adjustments in currency values cannot correct these imbalances, differences in growth of wages must do the job—either wage deflation and continued depression in Greece and other peripheral countries, wage inflation in Germany, or both. The former is a recipe for intense and sustained misery. The latter, however politically improbable it may now seem, is the better alternative.

The long-term problem is that the eurozone lacks the fiscal transfer mechanisms necessary to soften the effects of competitiveness imbalances while other forms of adjustment take effect. This lack places extraordinary demands on the willingness of individual nations to undertake internal policies to reduce such imbalances. Until such fiscal transfer mechanisms are created, crises such as the current one are bound to recur.

Present circumstances call for a combination of short-term expansionary policies that have to be led or accepted by the surplus nations, notably Germany, who will also have to recognize and accept that not all Greek debts will be paid or that debt service payments will not be made on time and at originally negotiated interest rates. The price for those concessions will be a current and credible commitment eventually to restore and maintain fiscal balance by the peripheral countries, notably Greece.

The Supreme Court today decided that Congress meant what it said when it enacted the Affordable Care Act (ACA). The ACA requires people in all 50 states to carry health insurance and provided tax credits to help them afford it. To have offered such credits only in the dozen states that set up their own exchanges would have been cruel and unsustainable because premiums for many people would have been unaffordable.

But the law said that such credits could be paid in exchanges ‘established by a state,’ which led some to claim that the credits could not be paid to people enrolled by the federally operated exchange. In his opinion, Chief Justice Roberts euphemistically calls that wording ‘inartful.’ Six Supreme Court justices decided that, read in its entirety, the law provides tax credits in every state, whether the state manages the exchange itself or lets the federal government do it for them.

That decision is unsurprising. More surprising is that the Court agreed to hear the case. When it did so, cases on the same issue were making their ways through four federal circuits. In only one of the four circuits was there a standing decision, and it found that tax credits were available everywhere. It is customary for the Supreme Court to wait to take a case until action in lower courts is complete or two circuits have disagreed. In this situation, the justices, eyeing the electoral calendar, may have preferred to hear the case sooner rather than later to avoid confronting it in the middle of a presidential election.

Whatever the Court’s motives for taking the case, their willingness to hear the case caused supporters of the Affordable Care Act enormous unease. Were the more conservative members of the Court poised to accept an interpretation of the law that ACA supporters found ridiculous but that inartful legislative drafting gave the gloss of plausibility? Judicial demeanor at oral argument was not comforting. A 5-4 decision disallowing payment of tax credits seemed ominously plausible.

The Court’s 6-3 decision ended those fears. The existential threat to health reform from litigation is over. But efforts to undo the Affordable Care Act are not at an end. They will continue in the political sphere. And that is where they should be. ACA opponents know that there is little chance for them to roll back the Affordable Care Act in any fundamental way as long as a Democrat is in the White House. To dismantle the law, they must win the presidency in 2016.

But winning the presidency will not be enough. It would be mid 2017 before ACA opponents could draft and enact legislation to curb the Affordable Care Act and months more before it could take effect. To borrow a metaphor from the military, even if those opposed to the ACA win the presidency, they will have to deal with ‘facts on the ground.’

The 2016 presidential election confronts the U.S. electorate with political choices more fundamental than any since 1964 and possibly since 1932. That statement may strike some as hyperbolic, but the policy differences between the two major parties and the positions of candidates vying for their presidential nominations support this claim.

A victorious Republican candidate would take office backed by a Republican-controlled Congress, possibly with heightened majorities and with the means to deliver on campaign promises. On the other hand, the coattails of a successful Democratic candidate might bring more Democrats to Congress, but that president would almost certainly have to work with a Republican House and, quite possibly, a still Republican Senate. The political wars would continue, but even a president engaged in continuous political trench warfare has the power to get a lot done.

Candidates always promise more than they can deliver and often deliver different policies from those they have promised. Every recent president has been buffeted by external events unanticipated when he took office. But this year, more than in half a century or more, the two parties offer a choice, not an echo. Here is a partial and selective list of key issues to illustrate what is at stake.

The Affordable Care Act, known as Obamacare or the ACA, passed both houses of Congress with not a single Republican vote. The five years since enactment of the ACA have not dampened Republican opposition.

The persistence and strength of opposition to the ACA is quite unlike post-enactment reactions to the Social Security Act of 1935 or the 1965 amendments that created Medicare. Both earlier programs were hotly debated and controversial. But a majority of both parties voted for the Social Security Act. A majority of House Republicans and a sizeable minority of Senate Republicans supported Medicare. In both cases, opponents not only became reconciled to the new laws but eventually participated in improving and extending them. Republican members of Congress overwhelmingly supported, and a Republican president endorsed, adding Disability Insurance to the Social Security Act.  In 2003, a Republican president proposed and fought for the addition of a drug benefit to Medicare.

The current situation bears no resemblance to those two situations. Five years after enactment of Obamacare, in contrast, every major candidate for the Republican presidential nomination has called for its repeal and replacement. So have the Republican Speaker of the House of Representatives and Majority Leader in the Senate.  

Just what 'repeal and replace' might look like under a GOP president remains unclear as ACA critics have not agreed on an alternative. Some plans would do away with some of the elements of Obamacare and scale back others. Some proposals would repeal the mandate that people carry insurance, the bar on 'medical underwriting' (a once-routine practice under which insurers vary premiums based on expected use of medical care), or the requirement that insurers sell plans to all potential customers. Other proposals would retain tax credits to help make insurance affordable but reduce their size, or would end rules specifying what 'adequate' insurance plans must cover.

Repeal is hard to imagine if a Democrat wins the presidency in 2016. Even if repeal legislation could overcome a Senate filibuster, a Democratic president would likely veto it and an override would be improbable. 

But a compromise with horse-trading, once routine, might once again become possible. A Democratic president might agree to Republican-sponsored changes to the ACA, such as dropping the requirement that employers of 50 or more workers offer insurance to their employees, if Republicans agreed to changes in the ACA that supporters seek, such as the extension of tax credits to families now barred from them because one member has access to very costly employer-sponsored insurance.

In sum, the 2016 election will determine the future of the most far-reaching social insurance legislation in half a century.

Social Security faces a projected long-term gap between what it takes in and what it is scheduled to pay out. Every major Republican candidate has called for cutting benefits below those promised under current law. None has suggested any increase in payroll tax rates. Each Democratic candidate has proposed raising both revenues and benefits. Within those broad outlines, the specific proposals differ.

Most Republican candidates would cut benefits across the board or selectively for high earners. For example, Senator Ted Cruz proposes to link benefits to prices rather than wages, a switch that would reduce Social Security benefits relative to current law by steadily larger amounts: an estimated 29 percent by 2065 and 46 percent by 2090. He would allow younger workers to shift payroll taxes to private accounts. Donald Trump has proposed no cuts in Social Security because, he says, proposing cuts is inconsistent with winning elections and because meeting current statutory commitments is 'honoring a deal.' Trump also favors letting people invest part of their payroll taxes in private securities. He has not explained how he would make up the funding gap that would result if current benefits are honored but revenues to support them are reduced. Senator Marco Rubio has endorsed general benefit cuts, but he has also proposed to increase the minimum benefit. Three Republican candidates have proposed ending payroll taxes for older workers, a step that would add to the projected funding gap.

Democratic candidates, in contrast, would raise benefits, across-the-board or for selected groups—care givers or survivors. They would switch the price index used to adjust benefits for inflation to one that is tailored to consumption of the elderly and that analysts believe would raise benefits more rapidly than the index now in use. All would raise the ceiling on earnings subject to the payroll tax. Two would broaden the payroll tax base.

As these examples indicate, the two parties have quite different visions for Social Security. Major changes, such as those envisioned by some Republican candidates, are not easily realized, however. Before he became president, Ronald Reagan in numerous speeches called for restructuring Social Security. Those statements did not stop him from signing a 1983 law that restored financial balance to the very program against which he had inveighed but with few structural changes. George W. Bush sought to partially privatize Social Security, to no avail. Now, however, Social Security faces a funding gap that must eventually be filled. The discipline of Trust Fund financing means that tax increases, benefit cuts, or some combination of the two are inescapable. Action may be delayed beyond the next presidency, as current projections indicate that the Social Security Trust Fund and current revenues can sustain scheduled benefits until the mid 2030s. But that is not what the candidates propose. Voters face a choice, clear and stark, between a Democratic president who would try to maintain or raise benefits and would increase payroll taxes to pay for it, and a Republican president who would seek to cut benefits, oppose tax increases, and might well try to partially privatize Social Security.

On no other issue is the split between the two parties wider or the stakes in their disagreement higher than on measures to deal with global warming. Leading Republican candidates have denied that global warming is occurring (Trump), scorned evidence supporting the existence of global warming as bogus (Cruz), acknowledged that global warming is occurring but not because of human actions (Rubio, Carson), or admitted that it is occurring but dismissed it as not a pressing issue (Fiorina, Christie). Congressional Republicans oppose current Administration initiatives under the Clean Air Act to curb emission of greenhouse gases.

Democratic candidates uniformly agree that global warming is occurring and that it results from human activities. They support measures to lower those emissions by amounts similar to those embraced in the Paris accords of December 2015 as essential to curb the speed and ultimate extent of global warming.

Climate scientists and economists are nearly unanimous that unabated emissions of greenhouse gases pose serious risks of devastating and destabilizing outcomes—that climbing average temperatures could render some parts of the world uninhabitable, that increases in sea levels that will inundate coastal regions inhabited by tens of millions of people, and that storms, droughts, and other climatic events will be more frequent and more destructive. Immediate actions to curb emission of greenhouse gases can reduce these effects. But no actions can entirely avoid them, and delay is costly.  Environmental economists also agree, with little partisan division, that the way to proceed is to harness market forces to reduce greenhouse gas emissions.” 

The division between the parties on global warming is not new. In 2009, the House of Representatives narrowly passed the American Clean Energy and Security Act. That law would have capped and gradually lowered greenhouse gas emissions. Two hundred eleven Democrats but only 8 Republicans voted for the bill. The Senate took no action, and the proposal died.

Now Republicans are opposing the Obama administration’s Clean Power Plan, a set of regulations under the Clean Air Act to lower emissions by power plants, which account for 40 percent of the carbon dioxide released into the atmosphere. The Clean Power Plan is a stop-gap measure. It applies only to power plants, not to other sources of emissions, and it is not nationally uniform. These shortcomings reflect the legislative authority on which the plan is based, the Clean Air Act. That law was designed to curb the local problem of air pollution, not the global damage from greenhouse gases. Environmental economists of both parties recognize that a tax or a cap on greenhouse gas emissions would be more effective and less costly than the current regulations, but superior alternatives are now politically unreachable.

Based on their statements, any of the current leading Republican candidates would back away from the recently negotiated Paris climate agreement, scuttle the Clean Power Plan, and resist any tax on greenhouse gas emissions. Any of the Democratic candidates would adhere to the Clean Power Plan and support the Paris climate agreement. One Democratic candidate has embraced a carbon tax. None has called for the extension of the Clean Power Plan to other emission sources, but such policies are consistent with their current statements.

The importance of global policy to curb greenhouse gas emissions is difficult to exaggerate. While the United States acting alone cannot entirely solve the problem, resolute action by the world’s largest economy and second largest greenhouse gas emitter is essential, in concert with other nations, to forestall climate catastrophe.

If the next president serves two terms, as six of the last nine presidents have done, four currently sitting justices will be over age 86 and one over age 90 by the time that presidency ends—provided that they have not died or resigned.

The political views of the president have always shaped presidential choices regarding judicial appointments. As all carry life-time tenure, these appointments influence events long after the president has left office. The political importance of these appointments has always been enormous, but it is even greater now than in the past. One reason is that the jurisprudence of sitting Supreme Court justices now lines up more closely than in the past with that of the party of the president who appointed them. Republican presidents appointed all sitting justices identified as conservative; Democratic presidents appointed all sitting justices identified as liberal. The influence of the president’s politics extends to other judicial appointments as well.

A second reason is that recent judicial decisions have re-opened decisions once regarded as settled. The decision in the first case dealing with the Affordable Care Act (ACA), NFIB v. Sibelius is illustrative.

When the ACA was enacted, few observers doubted the power of the federal government to require people to carry health insurance. That power was based on a long line of decisions, dating back to the 1930s, under the Constitutional clause authorizing the federal government to regulate interstate commerce. In the 1930s, the Supreme Court rejected an older doctrine that had barred such regulations. The earlier doctrine dated from 1905 when the Court overturned a New York law that prohibited bakers from working more than 10 hours a day or 60 hours a week. The Court found in the 14^th Amendment, which prohibits any state from ‘depriving any person of life, liberty or property, without due process of law,’ a right to contract previously invisible to jurists which it said the New York law violated. In the early- and mid-1930s, the Court used this doctrine to invalidate some New Deal legislation. Then the Court changed course and authorized a vast range of regulations under the Constitution’s Commerce Clause.  It was on this line of cases that supporters of the ACA relied.

Nor did many observers doubt the power of Congress to require states to broaden Medicaid coverage as a condition for remaining in the Medicaid program and receiving federal matching grants to help them pay for required medical services.

To the surprise of most legal scholars, a 5-4 Supreme Court majority ruled in NFIB v. Sibelius that the Commerce Clause did not authorize the individual health insurance mandate. But it decided, also 5 to 4, that tax penalties could be imposed on those who fail to carry insurance. The tax saved the mandate. But the decision also raised questions about federal powers under the Commerce Clause. The Court also ruled that the Constitution barred the federal government from requiring states to expand Medicaid coverage as a condition for remaining in the program. This decision was odd, in that Congress certainly could constitutionally have achieved the same objective by repealing the old Medicaid program and enacting a new Medicaid program with the same rules as those contained in the ACA that states would have been free to join or not.

NFIB v. Sibelius and other cases the Court has recently heard or soon will hear raise questions about what additional attempts to regulate interstate commerce might be ruled unconstitutional and about what limits the Court might impose on Congress’s power to require states to implement legislated rules as a condition of receiving federal financial aid. The Court has also heard, or soon will hear, a series of cases of fundamental importance regarding campaign financing, same-sex marriage, affirmative action, abortion rights, the death penalty, the delegation of powers to federal regulatory agencies, voting rights, and rules under which people can seek redress in the courts for violation of their rights.

Throughout U.S. history, the American people have granted nine appointed judges the power to decide whether the actions taken by elected legislators are or are not consistent with a constitution written more than two centuries ago. As a practical matter, the Court could not maintain this sway if it deviated too far from public opinion. But the boundaries within which the Court has substantially unfettered discretion are wide, and within those limits the Supreme Court can profoundly limit or redirect the scope of legislative authority. The Supreme Court’s switch in the 1930s from doctrines under which much of the New Deal was found to be unconstitutional to other doctrines under which it was constitutional illustrates the Court’s sensitivity to public opinion and the profound influence of its decisions.

The bottom line is that the next president will likely appoint enough Supreme Court justices and other judges to shape the character of the Supreme Court and of lower courts with ramifications both broad and enduring on important aspects of every person’s life.

***

The next president will preside over critical decisions relating to health care policy, Social Security, and environmental policy, and will shape the character of the Supreme Court for the next generation. Profound differences distinguish the two major parties on these and many other issues. A recent survey of members of the House of Representatives found that on a scale of ‘liberal to conservative’ the most conservative Democrat was more liberal than the least conservative Republican. Whatever their source, these divisions are real.  The examples cited here are sufficient to show that the 2016 election richly merits the overworked term 'watershed'—it will be the most consequential presidential election in a very long time.

Only days before her retirement at age 71, Kathleen Elliott Yinug succumbed to a recurrence of cancer, which had been in remission for fifteen years. Over a Brookings career spanning four decades, she not only assisted several members of the Brookings community, but also became their valued friend. A woman of intelligence and liberal values, she elicited, demanded, and merited the respect of all with whom she worked.

After college, she joined the Peace Corps and was sent to the island of Yap. There she met her husband to be and there her son, Falan, was born. The family returned to the United States so that her husband could attend law school. Kathleen came to work at Brookings, helping to support her husband's law school training. When he returned to Yap, Kathleen assumed all parental responsibility. Her son has grown into a man of character, a devoted husband and father of two daughters. He and his wife, Louise, with compassion and generosity, made their home Kathleen's refuge during her final illness. Over extended periods, she held second jobs to supplement her Brookings income.

Her personal warmth, openness, and personal integrity made her a natural confidante of senior fellows, staff assistants, and research assistants, alike. She demanded and received respect from all. Her judgment on those who did not meet her standards was blunt and final; on one occasion, she 'fired'—that is, flatly refused to work with—one senior staff member whose behavior and values she rightly deplored.

With retirement approaching, Kathleen bought a condominium in Maine, a place she had come to love after numerous visits with her long-time friend, Lois Rice. After additional visits, her affection for Maine residents and the community she had chosen deepened. She spoke with intense yearning for the post-retirement time when she could take up life in her new home. That she was denied that time is a cruel caprice of life and only deepens the sense of loss of those who knew and loved her.

Senior Fellows Ron Haskins and Isabel Sawhill are the first joint recipients of the Daniel Patrick Moynihan Prize from the American Academy of Political and Social Science (AAPSS). The prize is awarded each year to a leading policymaker, social scientist, or public intellectual whose career focuses on advancing the public good through social science. It was named after the late senator from New York and renowned sociologist Daniel Patrick Moynihan. The pair accepted the award May 12 at a ceremony in Washington, DC. 

In their joint lecture delivered at the ceremony, Haskins and Sawhill emphasized the importance of evidence-based public policy, highlighting Sawhill’s latest work in her book, Generation Unbound (Brookings, 2014). Watch their entire speech here:

“Marriage is disappearing and more and more babies are born outside marriage,” Sawhill said during the lecture. “Right now, the proportion born outside of marriage is about 40 percent. It’s higher than that among African Americans and lower than that among the well-educated. But it’s no longer an issue that just affects the poor or minority groups.”

Download Sawhill's slides » | Download Ron Haskins' slides »

The power of evidence-based policy is finally being recognized, Haskins added. “One of the prime motivating factors of the current evidence-based movement,” he said, “is the understanding, now widespread, that most social programs either have not been well evaluated or they don’t work.” Haskins continued:

Perhaps the most important social function of social science is to find and test programs that will reduce the nation’s social problems. The exploding movement of evidence-based policy and the many roots the movement is now planting, offer the best chance of fulfilling this vital mission of social science, of achieving, in other words, exactly the outcomes Moynihan had hoped for.

He pointed toward the executive branch, state governments, and non-profits implementing policies that could make substantial progress against the nation’s social problems.

Richard Reeves, a senior fellow at Brookings and co-director, with Haskins, of the Center on Children and Families (CCF), acknowledged Haskins and Sawhill’s “powerful and unique intellectual partnership” and their world-class work on families, poverty, opportunity, evidence, parenting, work, and education.

Haskins and Sawhill were the first to be awarded jointly by the AAPSS, which recognizes their 15-year collaboration at Brookings and the Center on Children and Families, which they established. In addition to their work at CCF, the two co-wrote Creating an Opportunity Society (Brookings 2009) and serve as co-editors of The Future of Children, a policy journal that tackles issues that have an impact on children and families.

Haskins and Sawhill join the ranks of both current and past Brookings scholars who have received the Moynihan Prize, including Alice Rivlin (recipient of the inaugural prize), Rebecca Blank, and William Julius Wilson along with other distinguished scholars and public servants.

Want to learn more about the award’s namesake? Read Governance Studies Senior Fellow and historian Steve Hess’s account of Daniel Patrick Moynihan’s time in the Nixon White House in his book The Professor and the President (Brookings, 2014).

Employment among lower-income men has declined by 11 percent since 1980 and has remained flat among lower-income women. Men and women in the top and middle of the income distribution, on the other hand, have been working as much or more since 1980, creating a growing “work gap” in labor market income between haves and have-nots.   

This paper simulates the effect of five labor market interventions (higher high school graduation rate, minimum wage increases, maintaining full employment, seeing all household heads work full time, and virtual marriages between single mothers and unattached men) on the average incomes of the poorest one-third of American households. They find that the most effective way to increase average incomes of the poorest Americans would be for household heads to work full time, whereas the least effective intervention would be increasing education.

In terms of actual impact on incomes, the simulation of all household heads working full time at their expected wage increased average household earnings by 54 percent from a baseline of $12,415 to $19,163. The research also suggests that even if all household heads worked just some—at expected wages or hours—average earnings would still increase by 16 percent.

The least effective simulation was increasing the high school graduation rate to 90 percent and having half of those “newly” graduated go on to receive some form of post-secondary education. The authors note that the low impact of increasing education on mobility is likely because only one in six of bottom-third adults live in a household in which someone gains a high school degree via the intervention.

Because single parents are disproportionately represented among low-income families, Sawhill and coauthors also explored the impact of adding a second earner to single-parent families through a simulation that pairs low-income, single-mother household heads with demographically similar but unrelated men. That simulation increased the average household earnings of the bottom-third only modestly, by $508, or about 4 percent.

Efforts to increase employment among heads of the poorest households must take into consideration why those household heads aren’t working, they note. According to data from the 2015 Census, the most cited reason for women not working is “taking care of home and family” and for men it is being “ill or disabled.”  

Downloads

• Download "One third of a nation: Strategies for helping working families"

When Franklin Roosevelt delivered his second inaugural address on January 20, 1936 he lamented the “one-third of a nation ill-housed, ill-clad, ill-nourished.” He challenged Americans to measure their collective progress not by “whether we add more to the abundance of those who have much; [but rather] whether we provide enough for those who have too little.” In our new paper, One third of a nation: Strategies for helping working families, we ask a simple question: How are we doing?

In brief, we find that:

• The gulf in labor market income between the haves and have-nots remains wide. The median income of households in the bottom third in 2014 was $24,000, just a little more than a quarter of the median of $90,000 for the top two-thirds.
• The bottom-third households are disproportionately made up of minority adults, adults with limited educational attainment, and single parents.  
• The most important reason for the low incomes of the bottom third is a “work gap”: the fact that many are not employed at all, or work limited hours. 

The work gap

The decline in labor force participation rates has been widely documented, but the growing gulf in the work gap between the bottom third and the rest of the population is truly striking:

While the share of men who are employed in the top two-thirds has been quite stable since 1980, lower-income men’s work rates have declined by 11 percentage points. What about women?

Middle- and upper-income women have increased their work rates by 13 percentage points. This has helped maintain or even increase their family’s income. But employment rates among lower-income women have been flat, despite reforms of the welfare system and safety net designed to encourage work.

Many on the left point to problems like low pay and lack of access to affordable childcare, and so favor a higher minimum wage and more subsidies for daycare. For many conservatives, the problem is rooted in family breakdown and a dependency-inducing safety net. They therefore champion proposals like marriage promotion programs and strict work requirements for public benefits. Most agree about the importance of education.

Time to debate some more radical solutions 

It may be that the standard solutions to the problems of the bottom third, while helpful, are no longer sufficient. A debate about whether to make safety net programs such as Food Stamps and housing assistance conditional on work or training is underway. So are other solutions such as subsidized jobs (created by some states during the Great Recession as a natural complement to a work-conditioned safety net), more work sharing (used in Germany during the recession), or even a universal basic income (being considered by Swiss voters in June).

The Horatio Alger ideal of upward mobility has a strong grip on the American imagination (Reeves 2014). But recent years have seen growing concern about the distance between the rhetoric of opportunity and the reality of intergenerational mobility trends and patterns.

The related issues of equal opportunity, intergenerational mobility, and inequality have all risen up the agenda, for both scholars and policymakers. A growing literature suggests that the United States has fairly low rates of relative income mobility, by comparison to other countries, but also wide variation within the country. President Barack Obama has described the lack of upward mobility, along with income inequality, as “the defining challenge of our time.” Speaker Paul Ryan believes that “the engines of upward mobility have stalled.”

But political debates about equality of opportunity and social and economic mobility often provide as much heat as light. Vitally important questions of definition and motivation are often left unanswered. To what extent can “equality of opportunity” be read across from patterns of intergenerational mobility, which measure only outcomes? Is the main concern with absolute mobility (how people fare compared to their parents)—or with relative mobility (how people fare with regard to their peers)? Should the metric for mobility be earnings, income, education, well-being, or some other yardstick? Is the primary concern with upward mobility from the bottom, or with mobility across the spectrum?

In this paper, we discuss the normative and definitional questions that guide the selection of measures intended to capture “equality of opportunity”; briefly summarize the state of knowledge on intergenerational mobility in the United States; describe a new microsimulation model designed to examine the process of mobility—the Social Genome Model (SGM); and how it can be used to frame and measure the process, as well as some preliminary estimates of the simulated impact of policy interventions across different life stages on rates of mobility.

The three steps being taken in mobility research can be described as the what, the why, and the how. First, it is important to establish what the existing patterns and trends in mobility are. Second, to understand why they exist—in other words, to uncover and describe the “transmission mechanisms” between the outcomes of one generation and the next. Third, to consider how to weaken those mechanisms—or, put differently, how to break the cycles of advantage and disadvantage.

Download "Modeling Equal Opportunity" »

Downloads

• Download "Modeling Equal Opportunity"