fec

Risk evaluation and mitigation strategies (REMS): Building a framework for effective patient counseling on medication risks and benefits

Event Information

July 24, 2015
8:45 AM - 4:15 PM EDT

The Brookings Institution
1775 Massachusetts Ave., NW
Washington, DC

Under the Food and Drug Administration Amendments Act (FDAAA) of 2007, the FDA has the authority to require pharmaceutical manufacturers to develop Risk Evaluation and Mitigation Strategies (REMS) for drugs or biologics that carry serious potential or known risks. Since that time, the REMS program has become an important tool in ensuring that riskier drugs are used safely, and it has allowed FDA to facilitate access to a host of drugs that may not otherwise have been approved. However, concerns have arisen regarding the effects of REMS programs on patient access to products, as well as the undue burden that the requirements place on the health care system. In response to these concerns, FDA has initiated reform efforts aimed at improving the standardization, assessment, and integration of REMS within the health care system. As part of this broader initiative, the agency is pursuing four priority projects, one of which focuses on improving provider-patient benefit-risk counseling for drugs that have a REMS attached.

Under a cooperative agreement with FDA, the Center for Health Policy at Brookings held an expert workshop on July 24 titled, “Risk Evaluation and Mitigation Strategies (REMS): Building a Framework for Effective Patient Counseling on Medication Risks and Benefits”. This workshop was the first in a series of convening activities that will seek input from stakeholders across academia, industry, health systems, and patient advocacy groups, among others. Through these activities, Brookings and FDA will further develop and refine an evidence-based framework of best practices and principles that can be used to inform the development and effective use of REMS tools and processes.

Event Materials

       




fec

It’s the Family, Stupid? Not Quite…How Traditional Gender Roles Do Not Affect Women’s Political Ambition

In April of 2014, media outlets speculated whether Hillary Clinton’s future grandchild would impact her potential presidential campaign in 2016. Jennifer Lawless addresses the question of whether family roles and responsibilities affect a potential candidate’s political career. Lawless analyzes both female and male candidates and finds that traditional roles and responsibilities have little influence on candidates’ decision to run for office. 

      
 
 




fec

As coronavirus hits Latin America, expect serious and enduring effects

As COVID-19 passes across the globe, Latin America may be hard-hit, with deep humanitarian, economic, and political consequences. In early March, there was hope that the remoteness or the weather in Latin America might help it escape the virus. But within three weeks, the number of known infections jumped exponentially, spreading to every country in…

       




fec

Charts of the Week: Housing affordability, COVID-19 effects

In Charts of the Week this week, housing affordability and some new COVID-19 related research. How to lower costs of apartment building to make them more affordable to build In the first piece in a series on how improved design and construction decisions can lower the cost of building multifamily housing, Hannah Hoyt and Jenny…

       




fec

How is the coronavirus outbreak affecting China’s relations with India?

China’s handling of the coronavirus pandemic has reinforced the skeptical perception of the country that prevails in many quarters in India. The Indian state’s rhetoric has been quite measured, reflecting its need to procure medical supplies from China and its desire to keep the relationship stable. Nonetheless, Beijing’s approach has fueled Delhi’s existing strategic and economic concerns. These…

       




fec

Scaling Up: A Path to Effective Development

Introduction

The global community has set itself the challenge of meeting the Millennium Development Goals (MDGs) by 2015 as a way to combat world poverty and hunger. In 2007, the halfway point, it is clear that many countries will not be able to meet the MDGs without undertaking significantly greater efforts. One constraint that needs to be overcome is that development interventions—projects, programs, policies—are all too often like small pebbles thrown into a big pond: they are limited in scale, short-lived, and therefore have little lasting impact. This may explain why so many studies have found that external aid has had weak or no development impact in the aggregate, even though many individual interventions have been successful in terms of their project- or program-specific goals.

Confronted with the challenge of meeting the MDGs, the development community has recently begun to focus on the need to scale up interventions. Scaling up means taking successful projects, programs, or policies and expanding, adapting, and sustaining them in different ways over time for greater development impact. This emphasis on scaling up has emerged from concern over how to deploy and absorb the substantially increased levels of official development assistance that were promised by the wealthy countries at recent G8 summits. A fragmented aid architecture complicates this task; multilateral, bilateral, and private aid entities have multiplied, leading to many more—but smaller— aid projects and programs and increasing transaction costs for recipient countries. In response, some aid donors have started to move from project to program support, and in the Paris Declaration, official donors committed themselves to work together for better coordinated aid delivery.

The current focus on scaling up is not entirely new, however. During the 1980s, as nongovernmental organizations (NGOs) increasingly began to engage in development activities, scaling up emerged as a challenge. NGO interventions were (and are) typically small in scale and often apply new approaches. Therefore, the question of how to replicate and scale up successful models gained prominence even then, especially in connection with participatory and community development approaches. Indeed, the current interest among philanthropic foundations and NGOs in how to scale up their interventions is an echo of these earlier concerns.

In response to this increased focus on scaling up—and its increased urgency—this policy brief takes a comprehensive look at what the literature and experience have to say about whether and how to scale up development interventions.

Downloads

Authors

Publication: International Food Policy Research Institute
      
 
 




fec

Scaling Up: A Framework and Lessons for Development Effectiveness from Literature and Practice

Abstract

Scaling up of development interventions is much debated today as a way to improve their impact and effectiveness. Based on a review of scaling up literature and practice, this paper develops a framework for the key dynamics that allow the scaling up process to happen. The authors explore the possible approaches and paths to scaling up, the drivers of expansion and of replication, the space that has to be created for interventions to grow, and the role of evaluation and of careful planning and implementation. They draw a number of lessons for the development analyst and practitioner. More than anything else, scaling up is about political and organizational leadership, about vision, values and mindset, and about incentives and accountability—all oriented to make scaling up a central element of individual, institutional, national and international development efforts. The paper concludes by highlighting some implications for aid and aid donors.

An annotated bibliography of the literature on scaling up and development aid effectiveness was created by Oksana Pidufala to supplement this working paper. Read more »

Downloads

Authors

      
 
 




fec

Webinar: The effects of the coronavirus outbreak on marginalized communities

As the coronavirus outbreak rapidly spreads, existing social and economic inequalities in society have been exposed and exacerbated. State and local governments across the country, on the advice of public health officials, have shuttered businesses of all types and implemented other social distancing recommendations. Such measures assume a certain basic level of affluence, which many…

       




fec

The polarizing effect of Islamic State aggression on the global jihadi movement

      
 
 




fec

Charts of the Week: Housing affordability, COVID-19 effects

In Charts of the Week this week, housing affordability and some new COVID-19 related research. How to lower costs of apartment building to make them more affordable to build In the first piece in a series on how improved design and construction decisions can lower the cost of building multifamily housing, Hannah Hoyt and Jenny…

       




fec

Global Leadership in Transition : Making the G20 More Effective and Responsive


Brookings Institution Press with the Korean Development Institute 2011 353pp.

Global Leadership in Transition calls for innovations that "institutionalize" or consolidate the G20, helping to make it the global economy’s steering committee. The emergence of the G20 as the world’s premier forum for international economic cooperation presents an opportunity to improve economic summitry and make global leadership more responsive and effective, a major improvement over the G8 era.

The origin of Global Leadership in Transition—which contains contributions from three dozen top experts from all over the world—was a Brookings seminar on issues surrounding the 2010 Seoul G20 summit. That grew into a further conference in Washington and eventually a major symposium in Seoul.

“Key contributors to this volume were well ahead of their time in advocating summit meetings of G20 leaders. In this book, they now offer a rich smorgasbord of creative ideas for transforming the G20 from a crisis-management committee to a steering group for the international system that deserves the attention of those who wish to shape the future of global governance.”—C. Randall Henning, American University and the Peterson Institute

Contributors: Alan Beattie, Financial Times; Thomas Bernes, Centre for International Governance Innovation (CIGI); Sergio Bitar, former Chilean minister of public works; Paul Blustein, Brookings Institution and CIGI; Barry Carin, CIGI and University of Victoria; Andrew F. Cooper, CIGI and University of Waterloo; Kemal Derviş, Brookings; Paul Heinbecker, CIGI and Laurier University Centre for Global Relations; Oh-Seok Hyun, Korea Development Institute (KDI); Jomo Kwame Sundaram, United Nations; Homi Kharas, Brookings; Hyeon Wook Kim, KDI; Sungmin Kim, Bank of Korea; John Kirton, University of Toronto; Johannes Linn, Brookings and Emerging Markets Forum; Pedro Malan, Itau Unibanco; Thomas Mann, Brookings; Paul Martin, former prime minister of Canada; Simon Maxwell, Overseas Development Institute and Climate and Development Knowledge Network; Jacques Mistral, Institut Français des Relations Internationales; Victor Murinde, University of Birmingham (UK); Pier Carlo Padoan, OECD Paris; Yung Chul Park, Korea University; Stewart Patrick, Council on Foreign Relations; Il SaKong, Presidential Committee for the G20 Summit; Wendy R. Sherman, Albright Stonebridge Group; Gordon Smith, Centre for Global Studies and CIGI; Bruce Stokes, German Marshall Fund; Ngaire Woods, Oxford Blavatnik School of Government; Lan Xue, Tsinghua University (Beijing); Yanbing Zhang, Tsinghua University.

ABOUT THE EDITORS

Colin I. Bradford
Wonhyuk Lim
Wonhyuk Lim is director of policy research at the Center for International Development within the Korea Development Institute. He was with the Presidential Transition Committee and the Presidential Committee on Northeast Asia after the 2002 election in Korea. A former fellow with Brookings’s Center for Northeast Asian Policy Studies, he has written extensively on development and corporate governance issues.

Downloads

Ordering Information:
  • {9ABF977A-E4A6-41C8-B030-0FD655E07DBF}, 978-0-8157-2145-1, $29.95 Add to Cart
     
 
 




fec

Proximity to the flagpole: Effective leadership in geographically dispersed organizations


The workplace is changing rapidly, and more and more leaders in government and private industry are required to lead those who are geographically separated. Globalization, economic shifts from manufacturing to information, the need to be closer to customers, and improved technological capabilities have increased the geographic dispersion of many organizations. While these organizations offer many exciting opportunities, they also bring new leadership challenges that are amplified because of the separation between leaders and followers. Although much has been researched and written on leadership in general, relatively little has been focused on the unique leadership challenges and opportunities presented in geographically separated environments. Furthermore, most leaders are not given the right tools and training to overcome the challenges or take advantage of the opportunities when leading in these unique settings.

A survey of leaders within a geographically dispersed military organization confirmed there are distinct differences in how remote and local leaders operate, and most leadership tasks related to leading those who are remote are more difficult than with those who are co-located. The tasks most difficult for remote leaders are related to communicating, mentoring and building personal relationships, fostering teamwork and group identity, and measuring performance. To be effective, leaders must be aware of the challenges they face when leading from afar and be deliberate in their engagement.

Although there are unique leadership challenges in geographically dispersed environments, most current leadership literature and training is developed on work in face-to-face settings. Leading geographically dispersed organizations is not a new concept, but technological advances over the last decade have provided leaders with greater ability to be more influential and involved with distant teams than ever before. This advancement has given leaders not only the opportunity to be successful in a moment of time but ensures continued success by enhancing the way they build dispersed organizations and grow future leaders from afar.

Downloads

Authors

  • Scott M. Kieffer
Image Source: © Edgar Su / Reuters
     
 
 




fec

With Acosta’s resignation, how is high turnover affecting the administration?

Following Labor Secretary Alex Acosta's resignation, Kathryn Dunn Tenpas updates her count of the Trump administration's unprecedented levels of senior staff turnover and examines the effect leadership turmoil has on the ability of departments and agencies to govern. http://directory.libsyn.com/episode/index/id/10499969 Related material:  Tracking turnover in the Trump administration Why is Trump’s staff turnover higher than the…

       




fec

How might COVID-19 affect the global economy?

As COVID-19 continues to spread around the world, Warwick J. McKibbin joined us from his home in Australia to discuss how the novel coronavirus may disrupt the global economy. McKibbin, a nonresident senior fellow at Brookings, authored a recent report outlining seven different scenarios of how COVID-19 might evolve and the implications each scenario would…

       




fec

How will the 2018 midterm elections affect the courts?

Congress affects the courts in many ways—funding, operations, jurisdiction. Which judges are confirmed has increasingly become dependent partly on whether Republicans or Democrats have control of the Senate. Based on the results of upcoming 2018 midterm, the balance of power in Congress will determine what will happen in the courts in the future. Watch Brookings…

       




fec

How do education and unemployment affect support for violent extremism?

The year 2016 saw a spate of global terrorist attacks in United States, Ivory Coast, Belgium, France, Pakistan, Turkey and Nigeria, which has led to an increased focus on ways to combat terrorism and specifically, the threat of Daesh (Arabic acronym for ISIS, Islamic State of Iraq and Syria). Figures from Institute for Economics and…

       




fec

The effect of COVID-19 and disease suppression policies on labor markets: A preliminary analysis of the data

World leaders are deliberating when and how to re-open business operations amidst considerable uncertainty as to the economic consequences of the coronavirus. One pressing question is whether or not countries that have remained relatively open have managed to escape at least some of the economic harm, and whether that harm is related to the spread…

       




fec

Comments on “How automation and other forms of IT affect the middle class: Assessing the estimates” by Jaimovich and Siu

Nir Jaimovich and Henry Siu have written a very helpful and useful paper that summarizes the empirical literature by labor economists on how automation affect the labor market and the middle class. Their main arguments can be summarized as follows: The labor markets in the US (and other industrialized countries) has become increasingly “polarized” in…

       




fec

Turkey cannot effectively fight ISIS unless it makes peace with the Kurds


Terrorist attacks with high casualties usually create a sense of national solidarity and patriotic reaction in societies that fall victim to such heinous acts. Not in Turkey, however. Despite a growing number of terrorist attacks by the so-called Islamic State on Turkish soil in the last 12 months, the country remains as polarized as ever under strongman President Recep Tayyip Erdogan.

In fact, for two reasons, jihadist terrorism is exacerbating the division. First, Turkey's domestic polarization already has an Islamist-versus-secularist dimension. Most secularists hold Erdogan responsible for having created domestic political conditions that turn a blind eye to jihadist activities within Turkey.

It must also be said that polarization between secularists and Islamists in Turkey often fails to capture the complexity of Turkish politics, where not all secularists are democrats and not all Islamists are autocrats. In fact, there was a time when Erdogan was hailed as the great democratic reformer against the old secularist establishment under the guardianship of the military.

Yet, in the last five years, the religiosity and conservatism of the ruling Justice and Development Party, also known by its Turkish acronym AKP, on issues ranging from gender equality to public education has fueled the perception of rapid Islamization. Erdogan's anti-Western foreign policy discourse -- and the fact that Ankara has been strongly supportive of the Muslim Brotherhood in the wake of the Arab Spring -- exacerbates the secular-versus-Islamist divide in Turkish society.

Erdogan doesn't fully support the eradication of jihadist groups in Syria.

The days Erdogan represented the great hope of a Turkish model where Islam, secularism, democracy and pro-Western orientation came together are long gone. Despite all this, it is sociologically more accurate to analyze the polarization in Turkey as one between democracy and autocracy rather than one of Islam versus secularism.

The second reason why ISIS terrorism is exacerbating Turkey's polarization is related to foreign policy. A significant segment of Turkish society believes Erdogan's Syria policy has ended up strengthening ISIS. In an attempt to facilitate Syrian President Bashar Assad's overthrow, the AKP turned a blind eye to the flow of foreign volunteers transiting Turkey to join extremist groups in Syria. Until last year, Ankara often allowed Islamists to openly organize and procure equipment and supplies on the Turkish side of the Syria border.

Making things worse is the widely held belief that Turkey's National Intelligence Organization, or MİT, facilitated the supply of weapons to extremist Islamist elements amongst the Syrian rebels. Most of the links were with organizations such as Jabhat al-Nusra, Ahrar al-Sham and Islamist extremists from Syria's Turkish-speaking Turkmen minority.

He is trying to present the PKK as enemy number one.

Turkey's support for Islamist groups in Syria had another rationale in addition to facilitating the downfall of the Assad regime: the emerging Kurdish threat in the north of the country. Syria's Kurds are closely linked with Turkey's Kurdish nemesis, the Kurdistan Workers' Party, or PKK, which has been conducting an insurgency for greater rights for Turkey's Kurds since 1984.

On the one hand, Ankara has hardened its stance against ISIS by opening the airbase at Incirlik in southern Turkey for use by the U.S-led coalition targeting the organization with air strikes. However, Erdogan doesn't fully support the eradication of jihadist groups in Syria. The reason is simple: the Arab and Turkmen Islamist groups are the main bulwark against the expansion of the de facto autonomous Kurdish enclave in northern Syria. The AKP is concerned that the expansion and consolidation of a Kurdish state in Syria would both strengthen the PKK and further fuel similar aspirations amongst Turkey's own Kurds.

Will the most recent ISIS terrorist attack in Istanbul change anything in Turkey's main threat perception? When will the Turkish government finally realize that the jihadist threat in the country needs to be prioritized? If you listen to Erdogan's remarks, you will quickly realize that the real enemy he wants to fight is still the PKK. He tries hard after each ISIS attack to create a "generic" threat of terrorism in which all groups are bundled up together without any clear references to ISIS. He is trying to present the PKK as enemy number one.

Only after a peace process with Kurds will Turkey be able to understand that ISIS is an existential threat to national security.

Under such circumstances, Turkish society will remain deeply polarized between Islamists, secularists, Turkish nationalists and Kurdish rebels. Terrorist attacks, such as the one in Istanbul this week and the one in Ankara in July that killed more than 100 people, will only exacerbate these divisions.

Finally, it is important to note that the Turkish obsession with the Kurdish threat has also created a major impasse in Turkish-American relations in Syria. Unlike Ankara, Washington's top priority in Syria is to defeat ISIS. The fact that U.S. strategy consists of using proxy forces such as Syrian Kurds against ISIS further complicates the situation.

There will be no real progress in Turkey's fight against ISIS unless there is a much more serious strategy to get Ankara to focus on peace with the PKK. Only after a peace process with Kurds will Turkey be able to understand that ISIS is an existential threat to national security.

This piece was originally posted by The Huffington Post.

Publication: The Huffington Post
Image Source: © Murad Sezer / Reuters
      
 
 




fec

Why local governments should prepare for the fiscal effects of a dwindling coal industry

       




fec

Simulating the effects of tobacco retail restriction policies

Tobacco use remains the single largest preventable cause of death and disease in the United States, killing more than 480,000 Americans each year and incurring over $300 billion per year in costs for direct medical care and lost productivity. In addition, of all cigarettes sold in the U.S. in 2016, 35% were menthol cigarettes, which…

       




fec

Simulating the effects of tobacco retail restriction policies

Tobacco use remains the single largest preventable cause of death and disease in the United States, killing more than 480,000 Americans each year and incurring over $300 billion per year in costs for direct medical care and lost productivity. In addition, of all cigarettes sold in the U.S. in 2016, 35% were menthol cigarettes, which…

       




fec

How the downturn in US-China relations affects Taiwan

With so much news taking place inside Taiwan recently, one could be forgiven for not paying as close of attention to the seismic shifts taking place around Taiwan. The purpose of this column is to inject an outside perspective into public discourse in Taiwan, though, so I will just briefly congratulate Taiwan’s Legislative Yuan for…

       




fec

Measuring effects of the Common Core


Part II of the 2015 Brown Center Report on American Education

Over the next several years, policy analysts will evaluate the impact of the Common Core State Standards (CCSS) on U.S. education.  The task promises to be challenging.  The question most analysts will focus on is whether the CCSS is good or bad policy.  This section of the Brown Center Report (BCR) tackles a set of seemingly innocuous questions compared to the hot-button question of whether Common Core is wise or foolish.  The questions all have to do with when Common Core actually started, or more precisely, when the Common Core started having an effect on student learning.  And if it hasn’t yet had an effect, how will we know that CCSS has started to influence student achievement? 

The analysis below probes this issue empirically, hopefully persuading readers that deciding when a policy begins is elemental to evaluating its effects.  The question of a policy’s starting point is not always easy to answer.  Yet the answer has consequences.  You can’t figure out whether a policy worked or not unless you know when it began.[i] 

The analysis uses surveys of state implementation to model different CCSS starting points for states and produces a second early report card on how CCSS is doing.  The first report card, focusing on math, was presented in last year’s BCR.  The current study updates state implementation ratings that were presented in that report and extends the analysis to achievement in reading.  The goal is not only to estimate CCSS’s early impact, but also to lay out a fair approach for establishing when the Common Core’s impact began—and to do it now before data are generated that either critics or supporters can use to bolster their arguments.  The experience of No Child Left Behind (NCLB) illustrates this necessity.

Background

After the 2008 National Assessment of Educational Progress (NAEP) scores were released, former Secretary of Education Margaret Spellings claimed that the new scores showed “we are on the right track.”[ii] She pointed out that NAEP gains in the previous decade, 1999-2009, were much larger than in prior decades.  Mark Schneider of the American Institutes of Research (and a former Commissioner of the National Center for Education Statistics [NCES]) reached a different conclusion. He compared NAEP gains from 1996-2003 to 2003-2009 and declared NCLB’s impact disappointing.  “The pre-NCLB gains were greater than the post-NCLB gains.”[iii]  It is important to highlight that Schneider used the 2003 NAEP scores as the starting point for assessing NCLB.  A report from FairTest on the tenth anniversary of NCLB used the same demarcation for pre- and post-NCLB time frames.[iv]  FairTest is an advocacy group critical of high stakes testing—and harshly critical of NCLB—but if the 2003 starting point for NAEP is accepted, its conclusion is indisputable, “NAEP score improvement slowed or stopped in both reading and math after NCLB was implemented.” 

Choosing 2003 as NCLB’s starting date is intuitively appealing.  The law was introduced, debated, and passed by Congress in 2001.  President Bush signed NCLB into law on January 8, 2002.  It takes time to implement any law.  The 2003 NAEP is arguably the first chance that the assessment had to register NCLB’s effects. 

Selecting 2003 is consequential, however.  Some of the largest gains in NAEP’s history were registered between 2000 and 2003.  Once 2003 is established as a starting point (or baseline), pre-2003 gains become “pre-NCLB.”  But what if the 2003 NAEP scores were influenced by NCLB? Experiments evaluating the effects of new drugs collect baseline data from subjects before treatment, not after the treatment has begun.   Similarly, evaluating the effects of public policies require that baseline data are not influenced by the policies under evaluation.   

Avoiding such problems is particularly difficult when state or local policies are adopted nationally.  The federal effort to establish a speed limit of 55 miles per hour in the 1970s is a good example.  Several states already had speed limits of 55 mph or lower prior to the federal law’s enactment.  Moreover, a few states lowered speed limits in anticipation of the federal limit while the bill was debated in Congress.  On the day President Nixon signed the bill into law—January 2, 1974—the Associated Press reported that only 29 states would be required to lower speed limits.  Evaluating the effects of the 1974 law with national data but neglecting to adjust for what states were already doing would obviously yield tainted baseline data.

There are comparable reasons for questioning 2003 as a good baseline for evaluating NCLB’s effects.  The key components of NCLB’s accountability provisions—testing students, publicizing the results, and holding schools accountable for results—were already in place in nearly half the states.  In some states they had been in place for several years.  The 1999 iteration of Quality Counts, Education Week’s annual report on state-level efforts to improve public education, entitled Rewarding Results, Punishing Failure, was devoted to state accountability systems and the assessments underpinning them. Testing and accountability are especially important because they have drawn fire from critics of NCLB, a law that wasn’t passed until years later.

The Congressional debate of NCLB legislation took all of 2001, allowing states to pass anticipatory policies.  Derek Neal and Diane Whitmore Schanzenbach reported that “with the passage of NCLB lurking on the horizon,” Illinois placed hundreds of schools on a watch list and declared that future state testing would be high stakes.[v] In the summer and fall of 2002, with NCLB now the law of the land, state after state released lists of schools falling short of NCLB’s requirements.  Then the 2002-2003 school year began, during which the 2003 NAEP was administered.  Using 2003 as a NAEP baseline assumes that none of these activities—previous accountability systems, public lists of schools in need of improvement, anticipatory policy shifts—influenced achievement.  That is unlikely.[vi]

The Analysis

Unlike NCLB, there was no “pre-CCSS” state version of Common Core.  States vary in how quickly and aggressively they have implemented CCSS.  For the BCR analyses, two indexes were constructed to model CCSS implementation.  They are based on surveys of state education agencies and named for the two years that the surveys were conducted.  The 2011 survey reported the number of programs (e.g., professional development, new materials) on which states reported spending federal funds to implement CCSS.  Strong implementers spent money on more activities.  The 2011 index was used to investigate eighth grade math achievement in the 2014 BCR.  A new implementation index was created for this year’s study of reading achievement.  The 2013 index is based on a survey asking states when they planned to complete full implementation of CCSS in classrooms.  Strong states aimed for full implementation by 2012-2013 or earlier.      

Fourth grade NAEP reading scores serve as the achievement measure.  Why fourth grade and not eighth?  Reading instruction is a key activity of elementary classrooms but by eighth grade has all but disappeared.  What remains of “reading” as an independent subject, which has typically morphed into the study of literature, is subsumed under the English-Language Arts curriculum, a catchall term that also includes writing, vocabulary, listening, and public speaking.  Most students in fourth grade are in self-contained classes; they receive instruction in all subjects from one teacher.  The impact of CCSS on reading instruction—the recommendation that non-fiction take a larger role in reading materials is a good example—will be concentrated in the activities of a single teacher in elementary schools. The burden for meeting CCSS’s press for non-fiction, on the other hand, is expected to be shared by all middle and high school teachers.[vii] 

Results

Table 2-1 displays NAEP gains using the 2011 implementation index.  The four year period between 2009 and 2013 is broken down into two parts: 2009-2011 and 2011-2013.  Nineteen states are categorized as “strong” implementers of CCSS on the 2011 index, and from 2009-2013, they outscored the four states that did not adopt CCSS by a little more than one scale score point (0.87 vs. -0.24 for a 1.11 difference).  The non-adopters are the logical control group for CCSS, but with only four states in that category—Alaska, Nebraska, Texas, and Virginia—it is sensitive to big changes in one or two states.  Alaska and Texas both experienced a decline in fourth grade reading scores from 2009-2013.

The 1.11 point advantage in reading gains for strong CCSS implementers is similar to the 1.27 point advantage reported last year for eighth grade math.  Both are small.  The reading difference in favor of CCSS is equal to approximately 0.03 standard deviations of the 2009 baseline reading score.  Also note that the differences were greater in 2009-2011 than in 2011-2013 and that the “medium” implementers performed as well as or better than the strong implementers over the entire four year period (gain of 0.99).

Table 2-2 displays calculations using the 2013 implementation index.  Twelve states are rated as strong CCSS implementers, seven fewer than on the 2011 index.[viii]  Data for the non-adopters are the same as in the previous table.  In 2009-2013, the strong implementers gained 1.27 NAEP points compared to -0.24 among the non-adopters, a difference of 1.51 points.  The thirty-four states rated as medium implementers gained 0.82.  The strong implementers on this index are states that reported full implementation of CCSS-ELA by 2013.  Their larger gain in 2011-2013 (1.08 points) distinguishes them from the strong implementers in the previous table.  The overall advantage of 1.51 points over non-adopters represents about 0.04 standard deviations of the 2009 NAEP reading score, not a difference with real world significance.  Taken together, the 2011 and 2013 indexes estimate that NAEP reading gains from 2009-2013 were one to one and one-half scale score points larger in the strong CCSS implementation states compared to the states that did not adopt CCSS.

Common Core and Reading Content

As noted above, the 2013 implementation index is based on when states scheduled full implementation of CCSS in classrooms.  Other than reading achievement, does the index seem to reflect changes in any other classroom variable believed to be related to CCSS implementation?  If the answer is “yes,” that would bolster confidence that the index is measuring changes related to CCSS implementation. 

Let’s examine the types of literature that students encounter during instruction.  Perhaps the most controversial recommendation in the CCSS-ELA standards is the call for teachers to shift the content of reading materials away from stories and other fictional forms of literature in favor of more non-fiction.  NAEP asks fourth grade teachers the extent to which they teach fiction and non-fiction over the course of the school year (see Figure 2-1). 

Historically, fiction dominates fourth grade reading instruction.  It still does.  The percentage of teachers reporting that they teach fiction to a “large extent” exceeded the percentage answering “large extent” for non-fiction by 23 points in 2009 and 25 points in 2011.  In 2013, the difference narrowed to only 15 percentage points, primarily because of non-fiction’s increased use.  Fiction still dominated in 2013, but not by as much as in 2009.

The differences reported in Table 2-3 are national indicators of fiction’s declining prominence in fourth grade reading instruction.  What about the states?  We know that they were involved to varying degrees with the implementation of Common Core from 2009-2013.  Is there evidence that fiction’s prominence was more likely to weaken in states most aggressively pursuing CCSS implementation? 

Table 2-3 displays the data tackling that question.  Fourth grade teachers in strong implementation states decisively favored the use of fiction over non-fiction in 2009 and 2011.  But the prominence of fiction in those states experienced a large decline in 2013 (-12.4 percentage points).  The decline for the entire four year period, 2009-2013, was larger in the strong implementation states (-10.8) than in the medium implementation (-7.5) or non-adoption states (-9.8).  

Conclusion

This section of the Brown Center Report analyzed NAEP data and two indexes of CCSS implementation, one based on data collected in 2011, the second from data collected in 2013.  NAEP scores for 2009-2013 were examined.  Fourth grade reading scores improved by 1.11 scale score points in states with strong implementation of CCSS compared to states that did not adopt CCSS.  A similar comparison in last year’s BCR found a 1.27 point difference on NAEP’s eighth grade math test, also in favor of states with strong implementation of CCSS.  These differences, although certainly encouraging to CCSS supporters, are quite small, amounting to (at most) 0.04 standard deviations (SD) on the NAEP scale.  A threshold of 0.20 SD—five times larger—is often invoked as the minimum size for a test score change to be regarded as noticeable.  The current study’s findings are also merely statistical associations and cannot be used to make causal claims.  Perhaps other factors are driving test score changes, unmeasured by NAEP or the other sources of data analyzed here. 

The analysis also found that fourth grade teachers in strong implementation states are more likely to be shifting reading instruction from fiction to non-fiction texts.  That trend should be monitored closely to see if it continues.  Other events to keep an eye on as the Common Core unfolds include the following:

1.  The 2015 NAEP scores, typically released in the late fall, will be important for the Common Core.  In most states, the first CCSS-aligned state tests will be given in the spring of 2015.  Based on the earlier experiences of Kentucky and New York, results are expected to be disappointing.  Common Core supporters can respond by explaining that assessments given for the first time often produce disappointing results.  They will also claim that the tests are more rigorous than previous state assessments.  But it will be difficult to explain stagnant or falling NAEP scores in an era when implementing CCSS commands so much attention.   

2.  Assessment will become an important implementation variable in 2015 and subsequent years.  For analysts, the strategy employed here, modeling different indicators based on information collected at different stages of implementation, should become even more useful.  Some states are planning to use Smarter Balanced Assessments, others are using the Partnership for Assessment of Readiness for College and Careers (PARCC), and still others are using their own homegrown tests.   To capture variation among the states on this important dimension of implementation, analysts will need to use indicators that are up-to-date.

3.  The politics of Common Core injects a dynamic element into implementation.  The status of implementation is constantly changing.  States may choose to suspend, to delay, or to abandon CCSS.  That will require analysts to regularly re-configure which states are considered “in” Common Core and which states are “out.”  To further complicate matters, states may be “in” some years and “out” in others.

A final word.  When the 2014 BCR was released, many CCSS supporters commented that it is too early to tell the effects of Common Core.  The point that states may need more time operating under CCSS to realize its full effects certainly has merit.  But that does not discount everything states have done so far—including professional development, purchasing new textbooks and other instructional materials, designing new assessments, buying and installing computer systems, and conducting hearings and public outreach—as part of implementing the standards.  Some states are in their fifth year of implementation.  It could be that states need more time, but innovations can also produce their biggest “pop” earlier in implementation rather than later.  Kentucky was one of the earliest states to adopt and implement CCSS.  That state’s NAEP fourth grade reading score declined in both 2009-2011 and 2011-2013.  The optimism of CCSS supporters is understandable, but a one and a half point NAEP gain might be as good as it gets for CCSS.



[i] These ideas were first introduced in a 2013 Brown Center Chalkboard post I authored, entitled, “When Does a Policy Start?”

[ii] Maria Glod, “Since NCLB, Math and Reading Scores Rise for Ages 9 and 13,” Washington Post, April 29, 2009.

[iii] Mark Schneider, “NAEP Math Results Hold Bad News for NCLB,” AEIdeas (Washington, D.C.: American Enterprise Institute, 2009).

[iv] Lisa Guisbond with Monty Neill and Bob Schaeffer, NCLB’s Lost Decade for Educational Progress: What Can We Learn from this Policy Failure? (Jamaica Plain, MA: FairTest, 2012).

[v] Derek Neal and Diane Schanzenbach, “Left Behind by Design: Proficiency Counts and Test-Based Accountability,” NBER Working Paper No. W13293 (Cambridge: National Bureau of Economic Research, 2007), 13.

[vi] Careful analysts of NCLB have allowed different states to have different starting dates: see Thomas Dee and Brian A. Jacob, “Evaluating NCLB,” Education Next 10, no. 3 (Summer 2010); Manyee Wong, Thomas D. Cook, and Peter M. Steiner, “No Child Left Behind: An Interim Evaluation of Its Effects on Learning Using Two Interrupted Time Series Each with Its Own Non-Equivalent Comparison Series,” Working Paper 09-11 (Evanston, IL: Northwestern University Institute for Policy Research, 2009).

[vii] Common Core State Standards Initiative. “English Language Arts Standards, Key Design Consideration.” Retrieved from: http://www.corestandards.org/ELA-Literacy/introduction/key-design-consideration/

[viii] Twelve states shifted downward from strong to medium and five states shifted upward from medium to strong, netting out to a seven state swing.

« Part I: Girls, boys, and reading Part III: Student Engagement »

Downloads

Authors

     
 
 




fec

Eurozone desperately needs a fiscal transfer mechanism to soften the effects of competitiveness imbalances


The eurozone has three problems: national debt obligations that cannot be met, medium-term imbalances in trade competitiveness, and long-term structural flaws.

The short-run problem requires more of the monetary easing that Germany has, with appalling shortsightedness, been resisting, and less of the near-term fiscal restraint that Germany has, with equally appalling shortsightedness, been seeking. To insist that Greece meet all of its near-term current debt service obligations makes about as much sense as did French and British insistence that Germany honor its reparations obligations after World War I. The latter could not be and were not honored. The former cannot and will not be honored either.

The medium-term problem is that, given a single currency, labor costs are too high in Greece and too low in Germany and some other northern European countries. Because adjustments in currency values cannot correct these imbalances, differences in growth of wages must do the job—either wage deflation and continued depression in Greece and other peripheral countries, wage inflation in Germany, or both. The former is a recipe for intense and sustained misery. The latter, however politically improbable it may now seem, is the better alternative.

The long-term problem is that the eurozone lacks the fiscal transfer mechanisms necessary to soften the effects of competitiveness imbalances while other forms of adjustment take effect. This lack places extraordinary demands on the willingness of individual nations to undertake internal policies to reduce such imbalances. Until such fiscal transfer mechanisms are created, crises such as the current one are bound to recur.

Present circumstances call for a combination of short-term expansionary policies that have to be led or accepted by the surplus nations, notably Germany, who will also have to recognize and accept that not all Greek debts will be paid or that debt service payments will not be made on time and at originally negotiated interest rates. The price for those concessions will be a current and credible commitment eventually to restore and maintain fiscal balance by the peripheral countries, notably Greece.


Authors

Publication: The International Economy
Image Source: © Vincent Kessler / Reuters
     
 
 




fec

The polarizing effect of Islamic State aggression on the global jihadi movement

      
 
 




fec

Experts assess the nuclear Non-Proliferation Treaty, 50 years after it went into effect

March 5, 2020 marks the 50th anniversary of the entry into effect of the Treaty on the Non-Proliferation of Nuclear Weapons (NPT). Five decades on, is the treaty achieving what was originally envisioned? Where is it succeeding in curbing the spread of nuclear weapons, and where might it be falling short? Four Brookings experts on defense…

       




fec

The coronavirus is Iran’s perfect storm

       




fec

PG&E; Replacing 1,600 Smart Meters with a Rare Defect Affecting Customers' Billing

Pacific Gas & Electric, a California-based utility, has been plagued with issues during their major push to get smart meters installed in every household in their area, from complaints about possible health




fec

How drought has affected beauty routines in Cape Town

South African women have had to change the way they approach showering, hair care, and menstruation, due to the lack of water.




fec

Ozone hole is officially shrinking, proof that international treaties can be effective

New NASA study offers first direct proof that the ozone hole is recovering thanks to the Montreal Protocol treaty and the international ban on CFCs.




fec

Geoengineering Virus Infecting Gates Foundation?

Wealthy individuals funding geoengineering feasibility studies because no one else will.




fec

Cabin project follows stress-reducing effect of living in nature -- the Swedish way (Video)

Swedes enjoy an interesting "close-to-nature" lifestyle -- this informal study shows how it might help visitors from other countries.




fec

New study links chemical sunscreens to birth defects

Oxybenzone may be effective at filtering UV light, but it comes at a dangerously high cost to human health.




fec

GM Volt Versus Toyota Prius: Which Design Type Will Be More Effective At Reducing Stack & Tailpipe Emissions, And Energy Consumption?

This is one of those comparison posts that that could draw many angry comments: like Could Hype Sell An Inferior Hybrid? - Ford Fusion versus Toyota Camry did. Please carefully read the caveats.




fec

Hey Google, this rooftop solar cooker is perfect for your self-driving car

Why turn your car into a living room when it can also be a kitchen?




fec

Climate Change Affecting Pakistani Power Supplies

Basically, Pakistan's hydroelectric reservoirs are drying up. Several are reported to be at "dead level," which means the turbines can only use run-of-the-river flows, and have lower output as a result. Because natural gas supplies are also low,




fec

Majesteas are the Perfect Hostess Gift

You are visiting a cottage, you have to bring something and you want it to be nice. What to do?




fec

Drinking tea affects women differently from men

Still unknown: are the effects due to women drinking more tea than men?




fec

Tiny 169 sq. ft. Backyard Reading Retreat is perfect for book lovers

Built for two bookstore owners, this elegant structure doubles as a place to read and for guests to stay in.




fec

Perfect Plant? 7 Great Uses For Industrial Hemp

Not to overly play into the stereotype of the TreeHugger moniker, but today is 4/20 so a quick review of all the great uses for industrial hemp--you




fec

Photo: Pelican flyby demonstrates perfect form

Our photo of the day comes from Florida's John D MacArthur Beach State Park.




fec

Field Guide to Eco-Friendly, Efficient, Effective Print

Design like you give a damn with the second edition of Monadnock Paper Mills' how-to guide for creating more-sustainable print materials. A Field Guide: Eco-Friendly, Efficient and Effective Print, accompanied by luscious illustrations by the




fec

15-year-old invents smart microwave that heats foods to their perfect temperature

The teen has been building the DIY microwave, hoping to solve many cooking problems with one device.




fec

Be Ready for Anything with Take Out Furniture, it's Perfect For Preppers

Clever idea from Finnish designer combines portable storage with fixed dresser unit




fec

Witness the amazing hamster wheel standing desk, perfect for the office rat race

The wheels on the desk go round and round.




fec

Dhaka, Manila & Jakarta Worst Climate-Affected Asian Mega-Cities - Hits Closer to Home Than You Might Think

Want to know which cities in Asia are going to get really whacked by climate change, and which ones have the greatest ability to adapt to it? Well, WWF has just released a new report that ranks 11 of them




fec

Passive House and permaculture are a perfect mix

A lot of the permaculture design principles make just as much sense for buildings.




fec

Hawaii’s plastic bag ban goes into effect, but…

On the first of this month, Hawaii became the first state in the U.S. to put a plastic bag ban into effect.




fec

Finding A Perfect Tike Bike

trioBike has released the next version of its tri-functional cargo bike, which we first wrote about here. The 2.0 Balanced is an aerodynamic and sleek-looking kid-hauler. And the detachable bike, a Shimano Nexus 7-speed, also looks great when you are out