ESEA Waivers

An Ocean of Unknowns in Using Student Achievement Data to Evaluate Early Grade Teachers

  • By
  • Laura Bornfreund
May 14, 2013
Publication Image

More than 20 states now require measures of student achievement to carry significant weight in teachers’ effectiveness ratings – even in the earliest grades, in which children do not participate in state standardized testing. As a result, states and school districts are struggling to find sound methods to measure young students’ learning.

Waiver Watch: Are District Waivers Rotten to the CORE?

  • By
  • Anne Hyslop
May 7, 2013
Publication Image

The California Office to Reform Education (CORE) is now one step closer to becoming the first group of school districts to receive a waiver from No Child Left Behind (NCLB). Last week, the nine CORE districts received feedback from the Department of Education after their official peer review. Moving the application to peer review sent a clear signal that the Department was considering the request seriously; remember, California’s state-level request was denied prior to the review stage.

CORE chose not to release specific comments from the peer review until their districts have addressed any concerns in a revised proposal. According to Education Week’s Politics K-12 blog, a spokeswoman for CORE explained: "As you can imagine, the parties who are opposing district-level waivers are looking for any opportunity to criticize, and we worry that if we don't release the peer review and our responsive update at the same time we will face a 'death by a thousand paper cuts' situation."

But CORE did release a summary of the reviewers’ concerns. Reviewers clearly had questions about how additional districts could join CORE and begin implementing the waiver with, or without, further involvement from the Department. And they also requested more details across all three flexibility principles: standards and assessments, accountability and school improvement, and instruction and leadership.

As I wrote in an earlier post, I have several questions about the viability of district-level flexibility when waivers (and NCLB, for that matter) were designed to work through state-level policy. And my objections seem rather tame compared to those coming from some civil rights organizations, state leaders, lawmakers, and policy wonks. Given the number of organizations and leaders speaking out against district waivers, why does Department continue to press on? Despite my own hesitancy to embrace its plan, here is the best case I can muster in support of the CORE proposal.

Size matters. CORE’s waiver is under consideration, in part, because these districts represent over a million students, in one of the nation’s largest states. In fact, CORE serves more students than 24 of the 34 approved waiver states. Frankly, if nine small districts in Montana had applied, we likely wouldn’t be having this conversation. Further, CORE’s districts are well ahead of their state, enacting reforms the Department would like to see across California, including longitudinal data systems, Common Core implementation, and teacher evaluation. Rewarding these districts would send a strong signal to the state of California about its own policy choices.

Promoting Innovation. Despite cries for “multiple measures” and less emphasis on testing, most states didn’t use their waivers to experiment much with accountability. Instead, states continued to rely on math and reading proficiency levels to identify priority and focus schools. CORE took the opposite approach. The districts proposed to use tests from schools’ highest grade level only for accountability, While peer reviewers nixed this idea, CORE’s plan still broadens the scope of accountability by including social/emotional and school climate domains alongside academics. In addition to proficiency, growth, and graduation rates, CORE’s accountability system will include: chronic absenteeism, suspensions and expulsions, non-cognitive skills, student and parent perception surveys, special education identification, and redesignation for English language learners. These measures will provide a more holistic picture of students’ performance for educators, parents, and policymakers. If the Department is seeking to reward innovation via waivers, the CORE request is more inventive than any I’ve seen.

The problem with being creative, however, is that CORE can offer few details about how it will work. And based on reports of the reviewers’ comments, I suspect they want these details too. How will CORE measure non-cognitive skills? Who will design the surveys? What annual performance targets will be set in each domain, and will each carry the same weight? How will these targets be used to identify priority, focus, and reward schools? According to CORE’s request, these questions may not be answered until the 2015-16 school year. Given this timeline, does CORE merit flexibility now?

All Improvement is Local. CORE’s proposal hinges on unprecedented cooperation between districts. While other waivers rely on capacity provided by states, CORE does not have that luxury. Instead, CORE districts must agree to develop and share Common Core-aligned performance tasks and assessments, report common measures to a CORE data system, hold each other’s schools accountable for meeting performance targets, and use individual schools’ expertise as a primary tool for turnaround, pairing high-achieving schools with low-performing ones for coaching.

In some ways this could be a strength. School and district staff may have more credibility and expertise than state officials, far removed from the local context, in leading turnaround efforts and developing instructional resources or professional development. Additionally, given the size of CORE, they have greater capacity than many state education agencies. However, districts don’t have a stellar record of holding all schools and students to rigorous standards and providing meaningful accountability, and they certainly don’t have as many policy tools to wield as a state education agency.

The bottom line is that both districts and states have a role to play in implementing NCLB flexibility and improving the quality of teaching and learning. Many states have recognized this in their waivers by relying more heavily on districts’ strengths and capabilities to improve schools and support teachers. The question is whether CORE’s plan can work without a strong state role at all. I’m still not sold.

College-Ready Wars: Assessing Threats to the Common Core

  • By
  • Anne Hyslop
April 19, 2013
Publication Image

Although the deadline for all students to achieve proficiency in math and reading has been lifted in most states by No Child Left Behind (NCLB) waivers, 2014 test anxiety is high as ever. That’s because the 2014-15 school year is the first time 45 states and Washington, D.C. will be fully implementing the Common Core State Standards – including new tests that will be used as part of high-stakes accountability systems for schools and, in many cases, teachers and students. But when the time comes, will states stay the course? Practical concerns along with escalating political arguments already threaten the emerging system of common standards and assessments.

As I wrote previously, Alabama became the first state to exit the Common Core test consortia, opting instead to administer ACT-based assessments. By 2014, Alabama will likely not be alone in its choice. ACT is a well-established player that has spent decades building an organization with a reputation for providing valid, reliable assessments. Conversely, the state consortia are upstarts, attempting to build next-generation assessments and a precarious, multi-state structure to support and sustain the effort simultaneously. Naturally, states are left with many unanswered questions. How much will the new tests costs, and what are the technical requirements? Will the tests accurately reflect a student’s readiness? And will the assessments even be completed on time? In his smart take on the issue, Bellwether Education Partner’s Andy Smarick writes, the ACT “is the ‘Plan B’ that many states – concerned about the reliability and cost of the consortia-developed tests – have been looking for. It enables a state to remain committed to tough standards and rigorous assessments without putting all of their eggs in the basket of a fragile multi-state entity.”

But this kind of pragmatic concern isn’t the only threat to the common standards. While the Common Core is a state-led initiative (I repeat, the Common Core is a state-led initiative), the effort has been supported by private and corporate philanthropy and by the federal government. Specifically, the requirement to adopt the common standards to compete for Race to the Top funding is at the heart of increasingly polarized and politicized arguments against the Common Core. In their words, “Obamacore” amounts to a “nationalized curriculum” and “leftist indoctrination” that has been “forced on state governments” and “imposed on the children of this nation.”

Reasonable individuals easily dismiss most of these arguments. But reasonable arguments are often overshadowed, especially when national politicians and parties start getting involved. Just last week, the Republican National Committee adopted an anti-Common Core resolution, echoing these same divisive arguments.  And President Obama frequently touts that his administration “convinced almost every state to develop smarter curricula and higher standards, all for about 1 percent of what we spend on education each year” – adding credibility to their claims.

The problem may be about to get worse. As noted in our Key Questions on the Obama Administration’s 2014 Education Budget Request, federal funding for the assessment consortia is set to expire before the tests are fully launched. To provide continued support, President Obama’s latest budget includes a $9 million competitive grant initiative that could finance some of their ongoing work. The other $380 million of the “Assessing Achievement” program would provide states with formula grants for their current assessment programs, although leftover funds could go toward Common Core implementation.

However, a significant change would occur in fiscal year 2015: Assessing Achievement formula funding would be available “only to States that have adopted college- and career-ready standards that are common to a significant number of States” (emphasis added). While Race to the Top included a similar requirement, that program was a competition, where states could opt-out. NCLB waivers also require states to adopt college- and career-ready standards, but they do not have to be common ones. The Assessing Achievement program would mark the first time federal formula funding – typically available to all states – required adoption of common standards. If enacted, this requirement will undoubtedly add fuel to the “Obamacore” fire. On the heels of the president’s budget request, Sen. Chuck Grassley (R-Ia) is calling for the federal government to eliminate all Department of Education funding that supports or prioritizes the Common Core – and he doesn’t even mention the Assessing Achievement program.

What can we make of these threats to the Common Core? To date, most of its political detractors have been contained outside of the mainstream and have had little success gaining traction or passing legislation to reverse Common Core adoption. Will the RNC resolution, Grassley’s letter, or potential changes in federal funding have a greater impact?

On the other hand, the pragmatic concerns about how the new standards and assessments will be implemented are just that – pragmatic. Few could fault Alabama’s decision to choose the ACT over PARCC and SmarterBalanced. All three of the developing testing systems could prove to be a great improvement over current assessments, measuring competencies better aligned to postsecondary work and providing more useful information to students, their teachers, parents, and policymakers.

The important difference between the practical and political critiques is that states deciding to use the ACT system are not necessarily backing away from their commitment to the Common Core altogether. Yes, the assessment consortia should do as much as possible to allay the concerns of wavering states. And yes, policymakers and stakeholders should closely monitor all of the emerging for-profit and non-profit ventures to ensure their assessments, curricula, textbooks, and other resources accurately reflect the new standards. But in the end, any damage done to the Common Core from these pragmatic objections to the consortia is far less severe than what would happen in the unlikely, but not out of the question, case that “Obamacore” goes mainstream. Common Core supporters would do well to distinguish between the two. 

Waiver Watch: District Waivers Go Off the Map

  • By
  • Anne Hyslop
April 4, 2013
Publication Image

The California Office to Reform Education (CORE) is closer to becoming the first consortium of school districts to receive a flexibility waiver from No Child Left Behind (NCLB). Although the nine CORE districts -- Clovis, Fresno, Long Beach, Los Angeles, Oakland, Sacramento, Sanger, and Santa Ana Unified -- submitted a formal waiver proposal to the U.S. Department of Education in February, speculation around district-level waivers had been percolating for months, particularly in states that were reluctant to apply for a waiver or failed to meet the Department’s waiver guidelines, like California.

Naturally, groups representing states -- like the Council of Chief State School Officers -- have significant concerns about district waivers, as it throws the relationship between local, state, and federal authority off kilter. Meanwhile, influential leaders in California, including State Board of Education President Michael Kirst and State Superintendent of Public Instruction Tom Torlakson, theoretically support the CORE request, but raise questions about how it would work in practice.

I share these concerns. Many states sought to unify state and federal policies via waivers and create a streamlined, more effective system of school accountability and improvement. But despite their intentions, most waivers are convoluted, confusing, and vague, presenting a challenge to those trying to monitor states’ progress and figure out what’s working (like me!). In other words, despite a common map and itinerary from the U.S. Department of Education, states chose very different, and often, indirect routes to arrive at their final waiver destination. Don’t get me wrong: variation and creativity aren’t necessarily bad things. Some states needed to spend more time developing teacher evaluations, or take a side trip and explore new approaches to student assessment. But, these variations certainly make the system more difficult to understand.

When it comes to waivers at the district level, the roadmap simply flies out the window. Most of the flexibility provisions within NCLB operate at the state level, making districts a far less logical driver of change. In most waiver states, local policies can be aligned with the federal-state waiver approach through legislation, regulation, and technical assistance from state education agencies. Schools and stakeholders within district waivers, however, will still have to navigate changing local, state, and federal systems -- just with fewer tools and resources at their disposal to bring the systems together. Thus, district waivers, by design, will likely create even more confusion.

Despite its deviations from the Department’s careful roadmap, the CORE proposal deserves to be taken seriously by waiver-watchers. Last week, the Department moved the request to the peer review stage, which means CORE’s proposal has already made it further down the road than California’s failed attempt. Therefore, it’s worth taking a closer look at the specifics within the CORE approach. Stay tuned for a full rundown of the CORE request in an upcoming post.

Waiver Watch: Deep in the Heart of Texas

  • By
  • Anne Hyslop
March 11, 2013
Publication Image

Texas has joined Pennsylvania, Wyoming, and 46 other states (including Washington, D.C.) in seeking waivers from No Child Left Behind (NCLB). With Nebraska and Montana sitting out, Vermont and North Dakota withdrawing, and California flat-out rejected, the pool of non-waiver states continues to shrink. But despite jumping on the waiver bandwagon, Texas breaks the mold in many respects.

Although the Lone Star State’s refusal to adopt the Common Core is one important distinction from other waiver winners, this wasn’t the detail I was most keen to uncover in their formal request. Texas’ plan to implement their own college- and career-ready standards and assessments actually stood out as one of the stronger points of their waiver, and other non-Common Core states, like Virginia and Minnesota, have successfully applied. Rather, Texas had originally considered asking the Department of Education for leeway to redesign the federal Title I funding formula – a provision that would have gone well beyond the flexibility granted to other states and a demand that would have undoubtedly made Texas’ waiver dead on arrival. To their credit, Texas officials removed this request, bringing their final proposal much closer to what the Department is offering.

But does this mean Texas’ waiver will be a hit with the U.S. Department of Education? Not so fast. While the proposal has strong points – like working with higher education to gain buy-in for college- and career-ready standards and articulating a plan to pilot teacher evaluations and scale them statewide – Texas’ proposed system of school accountability and improvement is not among them. In fact, Texas’ waiver could significantly undermine efforts to hold schools accountable for the performance of individual student subgroups.

Texas’ request is complicated by the fact that its state accountability system, which has operated in parallel to NCLB, is undergoing a significant overhaul, with many provisions yet to be finalized. Because Texas would like to fit its existing system into the waiver requirements, the state simply excluded these half-baked provisions from its request. Therefore, Texas’ waiver omits critical details, including how student progress will be measured, what annual performance targets will be, how each component within accountability will be weighted, and how focus and priority schools will be selected. Further, the application doesn’t even include Texas’ proposed framework, burying the information in attachments and hyperlinks.

For those that do seek out the information, Texas’ new performance index leaves a lot to be desired. Similar to other states, Texas plans to use a combination of four indices for accountability: student achievement, student progress, achievement gap closure, and postsecondary readiness. But the state does not specify how the index would translate into specific interventions, i.e. focus and priority schools.

Even more worrisome is how student subgroups and academic subjects will be treated across the four indices. While some states created “super-subgroups,” Texas took a different approach: ignore subgroups altogether.  Within the student achievement index, only the all students group is considered, with proficiency rates combined further across all subject areas. Yet for measuring student progress, subjects are considered separately and all traditional subgroups count– with the exception of low-income students, who are only considered within the performance gap closure index. But the gap closure measures do not consider English Language Learners or special education students. Finally, within the postsecondary readiness index, only racial subgroups are considered on one measure (advanced proficiency rates), while all subgroups (except low-income students) are considered for graduation rates. Texas does not provide a rationale for picking and choosing which indices apply to which subgroups.

Texas could also be plagued by an issue that cropped up in other waivers: annual performance targets. Texas’ targets would be based on the goal of cracking the top ten states nationally on college and career readiness by 2020 – a novel approach worth considering. But it’s unclear how the state could judge itself against others to define the annual targets. Texas is not a Common Core state, and existing national measures, like the SAT or ACT, would only apply to high schools. If the proposed readiness index were used instead, the ranking would be based on Texas assessments, students graduating with advanced Texas diplomas, and graduation rates. Using these measures, Texas would be number one by default – no other state has similar data.

Given these issues, I am doubtful that the Department could approve Texas’ request in its current form. There are simply too many unanswered questions and missing details. That said, Texas’ request is strong enough in other areas to allow for productive negotiations with the Department. With additional assurances and information from the Lone Star State, along with some give and take, NCLB flexibility could reach deep in the heart of Texas by the 2013-2014 school year.

Report: We’re Building a Grad Nation, but Challenges Remain

  • By
  • Anne Hyslop
February 27, 2013

While many education advocates prepare for the looming sequester on March 1, the education policy news in D.C. wasn’t all bad this week. The nation is now on track – for the first time– to reach a 90 percent high school graduation rate by 2020, according to the fourth annual Building a Grad Nation report. Released at the Grad Nation Summit, hosted by America’s Promise Alliance, the report analyzes trends in the national graduation rate, which increased from 71.7 percent in 2001 to 78.2 percent in 2010, and celebrates the significant advances states have made.

States’ progress has accelerated since 2006, thanks in part to an outsized 2.7 percentage point increase in the graduation rate between 2009 and 2010. The recent gains are also largely due to improved graduation rates for Hispanic students (10.4 point gain) and for black students (6.9 point gain). Two states – Wisconsin and Vermont – have already hit the 90 percent mark, and eighteen more are on pace to meet it by 2020.

Notably, these gains come at a time when many states also increased high school requirements and when schools faced heightened accountability measures under No Child Left Behind. In 2012, nine states required students to pass end-of-course exams to graduate, compared to only two in 2002. Six more states required students to take end-of-course exams in 2012, but did not require a passing score. States are also continuing to raise the bar with adoption of the Common Core and other college- and career-ready standards.

Further, Grad Nation reports that over a million students are no longer attending dropout factories, compared to 2002, and the overall number of dropout factories fell by nearly 600 schools. Dropout factories are high schools where twelfth grade enrollment is 60 percent or less then ninth grade enrollment three years earlier. Again, the beneficiaries of this trend were mostly minority students: in 2002, almost half of America’s black students attended a dropout factory, but in 2011, only a quarter did so – a fifty percent decline.

While celebrating the achievements of the last decade, the report also cites the challenges that lie between today’s status quo and the 2020 goal. Over twenty states are not on pace to achieve a 90 percent graduation rate. More troubling, persistent achievement gaps remain. In 30 states, at least one-third of students with disabilities fail to graduate. The same is true for English Language Learners in 33 states, black students in 20 states, and Hispanic students in 16 states. In many cases, the proportion of students failing to graduate in these subgroups is much higher.

Another challenge lies within the data. The 78.2 percent mark was determined using the Averaged Freshman Graduation Rate (AFGR), rather than the 4-year Adjusted Cohort Graduation Rate – the uniform methodology states and the federal government agreed to use in 2008. The Cohort Rate will enable a more consistent measure of graduation rates and allow states to more precisely identify schools and strategies that are preventing dropout. But there are technical questions about how to calculate the new rates. After the switch to the Cohort Rate in 2012, the difference between the old and new calculation methods was over five percentage points in nine states. Without a consistent measure, it is unclear how far and how fast states will need to improve to meet the 2020 goal.

Because of these lingering challenges, it is incredibly important for states and the federal government to remain vigilant in reporting accurate data and holding schools accountable for graduation rates, especially for at-risk students. As Ed Money Watch previously reported, many states have backtracked on commitments to graduation rate accountability in their waivers from No Child Left Behind – giving schools equal credit for students that take longer than four years to graduate, or counting GEDs and other non-diplomas. Further, many states are not holding schools accountable for – or even reporting – other measures that are critical early warning indicators of dropout, like chronic absenteeism.

With increased attention on students’ preparedness for college and careers after graduation, schools cannot forget about supporting students who are struggling just to finish their high school degree. To help, U.S. Secretary of Education Arne Duncan announced a new grant competition to place more AmeriCorps volunteers in the nation’s lowest-performing schools. While admirable, this is hardly a comprehensive solution. Federal and state lawmakers must do more and consider both goals – preventing dropout and increasing college and career readiness – equally when creating policies to measure and improve student achievement in our nation’s high schools.

Waiver Watch: The Real Lessons Learned from the Senate Waiver Hearing

  • By
  • Anne Hyslop
February 14, 2013
Publication Image

Tuesday was a big night for early education and higher education. But what about all the education that happens in between? Teachers were mentioned once, but in the context of deficit reduction, not education. No Child Left Behind (NCLB) and waivers fared even worse, with nary a word. But never fear, waiver watchers got all the coverage they needed last week from the Senate HELP Committee and Council of Chief State School Officers (CCSSO). In a hearing and subsequent CCSSO panel, policymakers and experts debated the early lessons from the waivers and implications for a near- or distant-future NCLB reauthorization.

For those following the waivers, however, the hearings were largely a disappointment – offering few specific insights from year one of implementation. District waivers? Still a possibility. Super subgroups are diluting accountability? Old news. If anything, the discussions mirrored  the HELP Committee markup over a year ago in its attempt at ESEA reauthorization. In fact, we learned more about reauthorization’s prospects than we did about the waivers. The hearing may have promised “lessons learned,” but those lessons depended entirely on who you asked:

Secretary Duncan – obviously – is a big cheerleader for the waivers, as opposed to working with Congress on a reauthorization: “My team and I put in hundreds and hundreds of hours in what proved to be a fruitless effort over the past two years. In all candor, I would like to have gone to waivers earlier.” He highlighted how states are focusing on subjects beyond math and reading, how more schools are being held accountable for student subgroup performance, and how states are promoting teacher quality, instead of credentials.

Although giving states options has benefits, not all states made good choices. As Andy Rotherham asked later, what do waivers look like in the hands of not-so-great state chiefs? Many declined to take advantage of new measures of student growth or postsecondary readiness. Worse, states often backtracked on plans to strengthen graduation rate and subgroup accountability, concerns highlighted by the Alliance for Excellent Education and Education Trust.

Democratic Senators and their allies, including Education Trust’s Kati Haycock, are no fans of NCLB, but have still taken issue with many of the features emerging in states’ waivers: super-subgroups, uneven goals that do not close achievement gaps and are not linked to any consequences, toothless school improvement policies, and more. Unfortunately, these groups are pointing out flaws in states’ waivers, but offering fewer solutions to fix them.

One option is for the Department to require states to amend their waivers if they don’t sufficiently meet the needs of vulnerable students (states can also voluntarily do so, with Department approval). But chiefs, like New Jersey’s Chris Cerf and Kentucky’s Terry Holliday, aren’t keen on the idea of mid-course corrections and more negotiations with ED. Given their reluctance and questions about how to monitor waivers, it seems unlikely that states will make significant changes. This doesn’t mean policymakers won’t learn anything from the waiver experiment, but it may take years for these lessons to be applied.

Another option is to push strongly for reauthorization. But this carries risks for civil rights groups given the preference for local control and even more state flexibility among Republican legislators, state chiefs, and governors. While HELP members like Senators Tom Harkin (D-IA) and Michael Bennet (D-CO) spoke of reauthorization, they appear unable to offer any new solutions that would present a departure from NCLB, recognize the concerns of the civil rights community, and maintain a strong federal role in education.

State schools chiefs, however, are advocating for reauthorization, but for a variety of reasons. First, they point out that many states do not have waivers. To New York Commissioner John King, this means there is no “floor” for state policy to safeguard against poor decisions. Alternatively, Holliday cited the need for long-term stability, because the waivers are subject to the Secretary of Education’s priorities. Regardless, all chiefs would welcome a new NCLB that maintains – or expands – flexibility. And most likely, the level of flexibility in the waivers would be the default starting point for any reauthorization right now. Lawmakers would receive incredible pushback if a new NCLB required states to dramatically alter the plans in which they’ve already invested a great deal of time, energy, and resources.

Republican Senators appear to be aligning most closely with the chiefs on reauthorization – less so in supporting waivers. Senator Lamar Alexander (R-TN) equated the waivers to an inside-the-beltway version of 'Mother May I,’ while Senator Pat Roberts (R-KS) lambasted the “regulatory purgatory” the Department created. In particular, Alexander was adamant that the government should not require states to adopt teacher evaluations based on student achievement. In one exchange with King, Alexander pressed: “We only give you 10 percent of your money. Why do I have to come from the mountains of Tennessee to tell New York that’s good for you?” But despite Alexander’s strong opinions, there is no consensus among the minority either – Senator Johnny Isakson (R-GA) seemed quite pleased with what his state accomplished in their waiver.

In short, reauthorization has not stalled because the waivers are popular. Rather, Republicans cannot make a strong-enough case for the level of local control many in their caucus seek, and Democrats prefer the temporary waiver policy to a decade of local control with little federal oversight. Without a clear alternative to NCLB that also provides a strong, compelling case for federal involvement in education, waivers really are their best choice.

The silver lining, as Bellwether Education Partners' Andy Smarick pointed out, is that with another year, or two, or three of waivers, some actual lessons might emerge that could inform and transform the thinking of those who seek a stronger federal role in K-12 policy – and those that don’t. We’ll be watching for them. Stay tuned.

College-Ready Wars Update: Alabama Leaves Test Consortia

  • By
  • Anne Hyslop
February 1, 2013
Publication Image

It seems that the stakes in the college-ready war have been raised. Today, Education Week broke the news that Alabama was pulling out as a participant in both Common Core testing consortia, PARCC and SmarterBalanced. Previously on Ed Money Watch, I noted that Alabama was getting ahead of the curve by implementing more rigorous assessments to measure students’ postsecondary preparedness before the new Common Core tests were ready to be delivered in the 2014-15 school year. I still believe this is a practical move for states that want better indicators now that their students are college- and career-ready (even better would be to collect evidence of students’ readiness based on their post-high school outcomes, like college enrollment, credit accumulation, and remediation rates).

In Alabama’s case, the new testing system was aligned to ACT’s battery of assessments – EXPLORE, PLAN, and the ACT. But as today's news and the state’s pending waiver request shows, this system is anything but temporary. In fact, the waiver request does not include their participation in either consortia as evidence the state adopted college- and career-ready assessments. Instead, the state touts their new system based on the ACT framework and indicates this is the system that will be in place in 2014-15. The news isn’t really news at all.

It was easy to see it coming. ACT was originally slated to work with PARCC to help develop their assessments, but wiggled out of the contract with plans to develop their own linked system of college- and career-ready assessments from kindergarten through high school into postsecondary. As I warned in my earlier post, for states like Alabama and Kentucky using the ACT and other established measures of college readiness, “it could be even more challenging to transition to Common Core benchmarks now that these states have institutionalized the ACT benchmarks.”

There’s a lot to be said for using ACT as a college-ready measure. The ACT is already accepted as a measure of readiness by those who actually make that decision: higher education institutions. ACT scores are used in college admissions decisions, and the ACT COMPASS exam is commonly used to determine whether students require remediation. On the other hand, no college has guaranteed they will use the PARCC or SmarterBalanced assessments for these decisions. While many higher education leaders are supportive of the Common Core effort, they have not yet had to make the ultimate decision that their standards for college readiness are the same as those adopted by forty-six states through the Common Core effort.  

Is this a sign of things to come? I wouldn’t be surprised if other states decide to go the ACT-route rather than stick with the consortia. That said, Alabama is less of a bellwether state than Massachusetts, Florida, or California. Leaving the consortia is also different than abandoning the Common Core entirely. There are still common academic standards across forty-six states and two comparable, high-quality assessments in development. But given that states seem to be considering the ACT as a serious alternative, it will be critical for both consortia to demonstrate their comparability to ACT and highlight any advantages their assessments offer.

More important, the consortia and Common Core advocates must engage more seriously with higher education to ensure their work is not a wasted effort. If the new standards promise to truly reflect “the knowledge and skills that our young people need for success in college and careers,” the only way to fulfill that promise is for mastery of the Common Core to be accepted as the definition of readiness by both secondary and postsecondary education. States’ public higher education systems control specific policies related to financial aid eligibility, admissions, credit-granting, dual enrollment, and remediation, among others, that will either promote or inhibit the Common Core. In order for authentic implementation of the Common Core to happen, the new standards and assessments must permeate not only K-12 policy, but also these policies at the postsecondary level.

Waiver Watch: Forecasting Obama's Second Term

  • By
  • Anne Hyslop
January 22, 2013
Publication Image

Much like the rest of President Obama’s signature education programs from the first term, the policy around ESEA flexibility seems to be shifting. The focus is no longer on how to win a waiver, but rather, on how to implement and monitor the commitments states made. Most states have secured their waiver, with only a handful waiting for approval from the Department of Education. While I’d encourage states to continue to refine their waivers based on lessons learned during implementation, no one has forced states (besides Virginia) to change their plans mid-course. Further, the Department has already shifted their attention to initiatives in early education and higher education.

So where does that leave the NCLB waivers in the second term? As I’ve written before, the waivers are insanely complicated, making it difficult for the public and even policymakers to parse out what states should be doing. That’s why it’s notable that the Senate HELP Committee wants to hold hearings on the waivers as soon as February, with testimony from Education Secretary Arne Duncan and state chiefs overseeing the waivers in their states. The House Education and Workforce committee is also mulling their role in providing oversight.  These hearings would likely involve some of the most controversial issues around graduation rate accountability, super subgroups, and different goals for minority and disadvantaged students.

While the hearings will likely shed light on the best – and worst – attributes of ESEA flexibility, the real question is whether they will lead to any meaningful action. The 112th Congress was the least productive and most polarized in history, and the 113th is not off to an auspicious start, with a so-called triple cliff to resolve before April: sequester, debt ceiling, and the expiration of the last budget continuing resolution. Add to that an unprecedented ‘to-do’ list for education – ESEA, IDEA, HEA, Perkins, WIA, CCDBG, Head Start, and the Education Services Reform Act are all pending renewal – and you have an environment where Congress will likely gripe about the waivers, but fail to reach a consensus on what to do about them.

The Obama administration seems to be betting on it. Over the next three years, states will implement their waivers and work through the kinks. By the time Congress gets its act together, states will have gone so far down the road with their new accountability and teacher evaluation systems that legislators will be hemmed in to passing a reauthorization that mirrors the flexibility policy. Secretary Duncan relayed this game plan in a speech to state chiefs: implementing the waivers “will have a big impact on shaping any reauthorization bill that might emerge.”

Given this context, here is what I’ll be watching in the second term:

District Waivers

For months, there have been rumblings of the Department offering district-level waivers for school systems in states that did not apply or were not approved for the larger flexibility plan – namely, California and Texas. Unsurprisingly, governors and state chiefs are not fans of the idea, and it is unclear what relief exactly the Department could give to districts without undermining the authority and autonomy of state education agencies. That said, eight districts in the California Office to Reform Education, or CORE, signaled their intent to apply for a waiver last week, before the Department even formally offered flexibility to them. How will Secretary Duncan respond to this request? Will the California Governor Jerry Brown or the State Board support their efforts? The CORE districts are some of the largest in California and have adopted reforms – like teacher evaluations – that doomed the state waiver request. Will other districts follow their lead?

Waiver Amendments

The waivers require states to overhaul accountability systems, implement college- and career-ready standards and assessments, and craft teacher evaluation systems based in part on student achievement. While many of these reforms could improve the state of education in the long term, the benefits are contingent on effective implementation.

Monitoring states’ waiver plans presents a significant challenge moving forward. In some states, new school grades and teacher evaluations appear arbitrary or inconsistent with past guidelines. Will states be receptive and responsive to feedback from educators, legislators, and the public? Just as states negotiated with the Department to draft their initial proposals, they have the opportunity to amend their plans at any time – Florida, Oklahoma, and South Carolina have done so already. Further, the Department should not rely on states alone to self-monitor their progress. With more states operating under a waiver than the original NCLB law, does the Department have the capacity to successfully monitor states’ activities? And if states do not follow through with their promises, will they intervene?

Stay tuned to the Waiver Watch for continuing coverage of these issues, and more, as states implement their flexibility plans.

What to Think about the MET Project Results

  • By
  • Anne Hyslop
January 17, 2013
Publication Image

What can you do with $45 million and three years? Well, if you’re the Bill & Melinda Gates Foundation, you can confirm, empirically, what educators have always known implicitly: great teaching matters, it can be measured, and it improves student learning.[1]

That was one of the many findings released last week in the final report from the MET Project (Measures of Effective Teaching). MET has generated buzz in education and popular media alike, so I won’t provide a full synopsis here. For a basic summary, check out the Washington Post or Huffington Post rundown; for more thoughtful commentary, turn to posts from Chad Aldeman, Andy Smarick, Rick Hess, Marty West, and National Journal Experts Blog. Instead, I want to call attention to two big takeaways from the MET Project.

What teacher evaluations measure is just as important as how they measure it.

Much has been made of the finding that classroom observations are the worst predictor of student learning, compared to state test scores and student surveys. Some have questioned whether observations are worth the significant time and personnel costs involved to do them well. Tim Daly of TNTP even claimed that MET shows “the way that most teachers have been evaluated forever is completely unreliable.”

It’s easy to jump to that conclusion: MET used proven, high-quality observation tools, and observers were trained and certified on their knowledge of them. This isn’t the case with many of the classroom observations used across the country.  Still, observations are a critical component of teacher evaluations, particularly for those in the early grades and in untested subjects. And using observations typically receives greater support from educators compared to test scores. Finally, MET’s research found that although classroom observations didn’t improve the predictive power of the evaluation measure, they did improve its reliability – or stability – from year to year. 

Test scores also don’t have the same diagnostic power as classroom observations: as Amanda Ripley put it, “test scores can reveal when kids are not learning; they can’t reveal why.” Observations can provide teachers with valuable, timely, and clear feedback on their practice. Given their complexity and the timing of state testing, value-added measures are far less teacher-friendly – not to mention, limited in scope. Surely, great teaching involves much more than improving student scores on multiple-choice tests in two subjects.

To this end, it’s laudable that MET’s researchers also used higher-order tests (the SAT 9 Open-Ended Reading Assessment and the Balanced Assessment in Mathematics) to measure student learning. In some states, these assessments are more similar to the Common Core assessments they will offer in 2014-15. Presumably, states should want teacher evaluations that not only function well with today’s tests, but also those of the future.

Still, the tests MET used only consider English Language Arts and math skills. If the ultimate goal of evaluations is to measure whether teachers create learning environments where students achieve a broader set of outcomes (say, the knowledge, skills, and attributes it takes to be college- and career-ready), then there is still a long way to go in developing these systems. In 2014, many states will be simultaneously implementing new teacher evaluations and the Common Core assessments. But the best evaluation systems today do a far better job identifying teachers that improve student learning via state test scores than teachers that improve college and career readiness. MET’s findings suggest that states should carefully consider whether their evaluation systems are measuring the teacher attributes needed to meet the Common Core’s objectives.

How teacher evaluations are used is just as important as what they measure.

Part of the demand for research like the MET Project comes from the push to use teacher evaluation systems to make human resources decisions. Hiring, retention, placement, compensation, and tenure can all be affected. Some of the push can be attributed directly to the Obama administration: developing and using teacher evaluation systems like the ones in the MET study for HR decisions was a major component of both Race to the Top and the No Child Left Behind waivers.

But there is still uncertainty surrounding teacher evaluation systems; the MET Project doesn’t provide a definitive roadmap or specific policies for states and districts looking to measure effective teaching. Many of its findings are ambiguous (with the exception that value-added measures must account for students’ prior test scores). The MET report is inconclusive when it comes to:

  • whether student demographics should be included as a control in value-added models;
  • precisely how to weight each component within a composite effectiveness measure: value-added data, student-perception surveys, and classroom observations;[2]
  • whether measures like the Content Knowledge for Teaching (CKT) tests or subject-based classroom observation tools could be useful additions to composite measures of teacher quality; and
  • who should observe teachers, how long these observations should last, and how many observations should occur each year.[3]

The teacher quality measures MET suggests are “better on virtually every dimension than the measures in use now.” But does that mean similar teacher evaluation systems should be used as the deciding factor for whether a teacher is fired? Or promoted? Or receives a pay increase?

Thorny questions, indeed. Yes, the new measures of effective teaching are promising, compared to most old-school teacher evaluation systems where nearly every teacher rated ‘satisfactory.’ But given MET’s lingering questions and inevitable measurement error in these measures of effectiveness, wouldn’t it make more sense to continue developing and refining teacher evaluation systems without rushing to use them for high-stakes decisions? Especially since most schools lack the capacity and resources to implement evaluations of the rigor and quality that the MET study used? States and districts should consider using the results from teacher evaluations in a more diagnostic manner: why not make these measures of effective teaching the first step in the process of providing professional development, determining who receives pay increases or tenure, and making decisions about hiring or firing – rather than the final step?



[1] In full disclosure, the work of New America’s Education Policy Program is supported, in part, with funding from the Gates Foundation.

[2] However, the “data suggest that assigning 50 to 33 percent of the weight to state test results maintains considerable predictive power, increases reliability, and potentially avoids the unintended negative consequences from assigning too-heavy weights to a single measure.”

[3]  MET’s results do show that more lessons and observers increases the reliability of observations, but there are “a range of scenarios for achieving reliable classroom observations.”

Syndicate content