West Virginia ESEA Flexibility Peer Review Panel Notes
ESEA Flexibility – Request Review Form U.S. Department of Education
ESEA Flexibility
Window 3
Request Review Form
State Request:West Virginia
Date:October 1, 2012
14512.1
ESEA Flexibility – Request Review Form U.S. Department of Education
REVIEW AND EVALUATION OF REQUESTS
The U.S. Department of Education (Department) will use a review process that will include both external peer reviewers and staff reviewers to evaluate State educational agency (SEA) requests for this flexibility. This review process will help ensure that each request for this flexibility approved by the Department is consistent with the principles, which are designed to support State efforts to improve student academic achievement and increase the quality of instruction, and is both educationally and technically sound. Reviewers will evaluate whether and how each request for this flexibility will support a comprehensive and coherent set of improvements in the areas of standards and assessments, accountability, and teacher and principal effectiveness that will lead to improved student outcomes. Each SEA will have an opportunity, if necessary, to clarify its plans for peer and staff reviewers and to answer any questions reviewers may have during the on-site review. The peer reviewers will then provide comments to the Department. Taking those comments into consideration, the Secretary will make a decision regarding each SEA’s request for this flexibility. If an SEA’s request for this flexibility is not granted, reviewers and the Department will provide feedback to the SEA about the components of the SEA’s request that need additional development in order for the request to be approved.
This document provides guidance for peer review panels as they evaluate each request during the on-site peer review portion of the review process. The document includes the specific information that a request must include and questions to guide reviewers as they evaluate each request. Questions that have numbers or letters represent required elements. The italicized questions reflect inquiries that reviewers will use to fully consider all aspects of an SEA’s plan for meeting each principle, but do not represent required elements.
In addition to this guidance, reviewers will also use the document titled ESEA Flexibility, including the definitions and timelines, when reviewing each SEA’s request. As used in the request form and this guidance, the following terms have the definitions set forth in the document titled ESEA Flexibility: (1) college- and career-ready standards, (2) focus school, (3) high-quality assessment, (4) priority school, (5) reward school, (6) standards that are common to a significant number of States, (7) State network of institutions of higher education, (8) student growth, and (9) turnaround principles.
Review Guidance
Consultation
Consultation Question 1 Peer Response
Response: (6 Yes or 0 No)
Consultation Question 1
/ Did the SEA meaningfully engage and solicit input on its request from teachers and their representatives?Is the engagement likely to lead to successful implementation of the SEA’s request due to the input and commitment of teachers and their representatives at the outset of the planning and implementation process?
Did the SEA indicate that it modified any aspect of its request based on input from teachers and their representatives?
Response Component / Panel Response
Rationale / The West Virginia Department of Education (WVDE) had a multi-faceted approach to engaging and soliciting input on its request from teachers and their representatives.
Strengths / WVDE engaged and solicited input from teachers and their representatives.
WVDE outlined stakeholder collaboration in the development of all three principles, listing dates and types of committees/task forces participating through onsite and online communication.
WVDE listed the groups from which it solicited feedback in Attachment 3. Teacher unions and professional educators were represented.
An option for online comment on the WVDE request was sent to all of the state’s 25,000 teachers and representatives of teacher organizations (p. 10).
Weaknesses, issues, lack of clarity / None.
Technical Assistance Suggestions / The request indicates that WVDE reviewed all public comment andincorporated appropriate items into the final request, but no examples were given. Given WVDE’s extensive outreach to the public, it would be useful for WVDE to highlight how it modified some aspects of the request based on public comment, particularly from teachers and their representatives.
WVDE could go through the request and pull references to consultation into this section (pp.70-71).
Consultation Question 2 Peer Response
Response: (6 Yes or0 No)
Consultation Question 2
/ Did the SEA meaningfully engage and solicit input on its request from other diverse communities, such as students, parents, community-based organizations, civil rights organizations, organizations representing students with disabilities and English Learners, business organizations, and Indian tribes?Is the engagement likely to lead to successful implementation of the SEA’s request due to the input and commitment of relevant stakeholders at the outset of the planning and implementation process?
Did the SEA indicate that it modified any aspect of its request based on stakeholder input?
Does the input represent feedback from a diverse mix of stakeholders representing various perspectives and interests, including stakeholders from high-need communities?
Response Component / Panel Response
Rationale / The WVDE had a multi-faceted approach to engaging and soliciting input on its request from diverse communities.
Strengths / WVDE listed the information received by date, individual’s role, and comments in Attachments 2 and 3, which demonstrated input from students, parents, community-based organizations (CBOs), civil rights organizations, organizations representing students with disabilities, English Learners, business organizations and high education community.
WVDE sought feedback for each of the three flexibility principles.
Stakeholders included K-12 teachers and representatives from higher education.
WVDE used multiple modes (in-person and online) to solicit input.
The three ESEA reform principles were featured eight times on West Virginia Board of Education (WVBE) monthly agendas (p. 10).
Local school boards were key stakeholders.
Weaknesses, issues, lack of clarity / WVDE met with LEA administrators to review school performance based upon the proposed accountability index measures,butit is not clear if WVDE modified any aspect of its request based on stakeholder input.
Technical Assistance Suggestions / The request indicates that WVDE reviewed all public comment and incorporated appropriate items into the final request, but no examples were given. Given the WVDE’s extensive outreach to the public, it would be useful to highlight how some aspects of the proposal were modified due to public comment, particularly from diverse communities and communities of high need.
Principle 1: College- and Career-Ready Expectations for All Students
Note to Peers: Staff will review 1.A Adopt College-And Career-Ready Standards, Options A and B.
1.B Transition to college- and career-ready standards
1.B Peer Response, Part A Peer Response
Response: (6 Yes or 0 No)
1.B Peer Response,
Part A
/ Part A: Is the SEA’s plan to transition to and implement college- and career-ready standards statewide in at least reading/language arts and mathematics no later than the 20132014 school year realistic, of high quality?Note to Peers: See ESEA Flexibility Review Guidance for additional considerations related to the types of activities an SEA includes in its transition plan.
Response Component / Panel Response
Rationale / The WVBE adopted the Common Core State Standards (CCSS) for English Language Arts & Literacy in History/Social Studies, Science, and Technical subjects and the CCSS for Mathematics in May 2010.
Strengths / The transition process was initiated in 2010.
The transition plan included cross-walking existing standards in order to identify gaps between state standards and CCSS.
WVDE began implementation of the college- and career-ready standards in September 2010. In January 2011, WVBE approved a schedule of implementation for the standards. Tables 1-1 through 1-10 in Appendix 1 outline the milestones, timelines, evidence, responsibility and resources for implementation of the standards.
Weaknesses, issues, lack of clarity / Numerous activities focused on implementing the CCSS; however, a larger strategic implementation and/or theory of action is not evident.
Technical Assistance Suggestions / WVDE should consider developing a strategic vision that allows communication with various constituency groups.
1.B Peer Response, PartB Peer Response
Response: (6 Yes or 0 No)
1.B Peer Response,
Part B
/ Part B: Is the SEA’s plan likely to lead to all students, including English Learners, students with disabilities, and low-achieving students, gaining access to and learning content aligned with the college- and career-ready standards?Response Component / Panel Response
Rationale / WVDE’srequest is likely to lead to all students gaining access to and learning content aligned with the college- and career-ready standards.
Strengths / WVDE focuses on training all teachers, including providing training to all teachers pertaining to students with disabilities.
WVDE identified specific strategies for students with disabilities, English Learners, and low-achieving students to gain access to the content aligned with college- and career-ready standards. WVDE is a partner in several consortia and federal technical assistancecenters (English Language Proficiency Assessment for the 21st Century [ELPA21], National Center on Response to Intervention [NCRTI], National Dropout Prevention Center for Students with Disabilities (NDPC-SD), National Center to Improve Recruitment and Retention of Qualified Personnel for Children with Disabilities [NCIPP]) to leverage access for English Learners, low achieving students, and students with disabilities. WVDE is accessing professional development and resources through these partnerships that should help the State educational agency (SEA)with implementation.
Weaknesses, issues, lack of clarity / WVDE has identified a number of professional development opportunities along with expansion of access to accelerated learning opportunities for students. A coherent approach to implementation would assist in resource allocation in this area.
Technical Assistance Suggestions / WVDE should consider developing and communicating a clear strategic vision regarding CCSS.
1.CDevelop and Administer Annual, Statewide, Aligned, High-Quality Assessments that Measure Student Growth
1.CDid the SEA develop, or does it have a plan to develop, annual, statewide, high-quality assessments, and corresponding academic achievement standards, that measure student growth and are aligned with the State’s college- and career-ready standards in reading/language arts and mathematics, in at least grades 3-8 and at least once in high school, that will be piloted no later than the 20132014 school year and planned for administration in all LEAs no later than the 20142015 school year, as demonstrated through one of the three options below? Does the plan include setting academic achievement standards?
Note to Peers: Staff will review Options A and C.
1.C, Option B Peer Response
Not applicable because the SEA selected 1.C, Option A or Option C
Response: NA
1.C, Option B
/ If the SEA selected Option B:If the SEA is neither participating in a State consortium under the RTTA competition nor has developed and administered high-quality assessments, did the SEA provide a realistic and high-quality plan describing activities that are likely to lead to the development of such assessments, their piloting no later than the 20132014 school year, and their annual administration in all LEAs beginning no later than the 20142015 school year? Does the plan include setting academic achievement standards?
Response Component / Panel Response
Rationale / NA
Strengths / NA
Weaknesses, issues, lack of clarity / NA
Technical Assistance Suggestions / NA
Note: WV is a governing state in the Smarter Balanced Assessment Consortium (SBAC)
Principle 1 Overall Review
Principle 1 Overall Review Peer Response
Response: (6 Yes or 0 No)
Principle 1
Overall Review
/ Is the SEA’s plan for transitioning to and implementing college-and career-ready standards, and developing and administering annual, statewide, aligned high-quality assessments that measure student growth, comprehensive, coherent, and likely to increase the quality of instruction for students and improve student achievement? If not, what aspects are not addressed or need to be improved upon?Response Component / Panel Response
Rationale / WVDE has developed an in-depth plan to transition to and implement college- and career-ready standards and related assessments. The plan involves multiple levels of the state support systems and specific efforts to improve instruction for all students, including students with disabilities, low-performing students, and English Learners.
Strengths / WVDE began implementation of the college- and career-ready standards in September 2010. In January 2011, WVBE approved a schedule of implementation for the standards. Tables 1-1 through 1-10 in Appendix 1 outlines the milestones, timelines, evidence, responsibility and resources for implementation of the standards.
WVDE identified specific strategies for students with disabilities, English Learners, and low-achieving students to gain access to the content aligned with college- and career-ready standards. WVDE is a partner in several consortia and federal technical assistancecenters (ELPA21, NCRTI, NDPD-SD, NCIPP) to leverage access for English Learners, low achieving students, and students with disabilities.WVDE is accessing professional development and resources through these partnerships that should help the State educational agency (SEA) with implementation.
Weaknesses, issues, lack of clarity / Numerous activities focused on implementing the common core; however, a larger strategic implementation plan and/or theory of action is not evident.
Technical Assistance Suggestions / WVDE should consider developing a strategic vision that allows communication with various constituency groups.
WVDE has identified a number of professional development opportunities along with expansion of access to accelerated learning opportunities for students; however, a coherent approach to implementation would assist in resource allocation in this area.
Principle 2: State-Developed Differentiated Recognition, Accountability, and Support
2.A Develop and Implement a State-Based System of Differentiated Recognition, Accountability, and Support
2.A.iPeer Response
Response: (0 Yes or 6 No)
2.A.i / Did the SEA propose a differentiated recognition, accountability, and support system, and a high-quality plan to implement this system no later than the 20132014 school year, that is likely to improve student achievement and school performance, close achievement gaps, and increase the quality of instruction for students? (note to Peers, please write to this question after completing 2.A.i.a and 2.A.i.b)Response Component / Panel Response
Rationale / WVDE proposes a plan of differentiated recognition, accountability, and support that will be implemented by 2013-2014 to improve school performance. The West Virginia Accountability Index (WVAI) and transformation model clearly reflect expectations, supports, and interventions. It is not clear, however, that the plan will improve student achievement and school performance, close achievement gaps, and increase the quality of instruction for students.
Strengths / WVDE’s plan of differentiated recognition, accountability, and support will be implemented no later than 2013-2014 school year.
The plan builds on the current transformational model included in the School Improvement Grants (SIG) program requirements.
Weaknesses, issues, lack of clarity / The weight of adequate growth — 10 percent in elementary/middle schools split between English/language arts and math and 5 percent in high schools split between English and math — is justified in the narrative (p. 77), but may not reflect appropriate expectations for all students to meet college- and career-ready standards.
WVDE did not provide the rationale and impact of the multiplier on each indicator.
The compensatory nature of the indicators may lead to unintentional consequences — e.g., growth doesnot overshadow proficiency.
WVDE did not provide the rationale and empirical evidence associated with the weighting of the growth indicator (actual v. observed growth).
Technical Assistance Suggestions / WVDE should submit impact data regarding subgroups, specifically students with disabilities, English Learners, and low achieving students.
2.A.i.aPeer Response
Response: (4 Yes or 2 No)
2.A.i.a
/ Does the SEA’s accountability system provide differentiated recognition, accountability, and support for all LEAs in the State and for all Title I schools in those LEAs based on (1) student achievement in reading/language arts and mathematics, and other subjects at the State’s discretion, for all students and all subgroups of students identified in ESEA section 1111(b)(2)(C)(v)(II); (2) graduation rates for all students and all subgroups; and (3) school performance and progress over time, including the performance and progress of all subgroups?Response Component / Panel Response
Rationale / WVDE articulates a differentiated accountability system that classifies schools into four levels and includes required components.
Strengths / WVAI uses multiple measures to assess school performance, including student growth.
WVDE vetted and ran simulations to analyze the WVAI (p. 70).
Expected gains are differentiated for elementary, middle, and high schools (p. 95-96).
Weaknesses, issues, lack of clarity / It is not clear that WVDE addresses graduation rates for subgroups.
Four classifications of schools (highly effective, effective, needs improvement, and targeted for support) and then three labels required by ESEA flexibility (priority, focus, and reward schools) may be confusing to stakeholders (p. 69). The value of sustaining state categories as well as federal ones is not clear.
Of particular concern is how an improvement of only 4 median percentiles from 49 to 53 transforms the multiplier from .50 to .75.
The weight of adequate growth — 10 percent in elementary/middle schools split between English/language arts and math and 5 percent in high schools split between English and math — is justified in the narrative (p. 77), but may not reflect appropriate expectations for all students to meet college- and career-ready standards.
The second metric is that adequate growth contributes 10 percent for elementary/middle schools and 5% for high schools. This appears to be a type of growth to standards (expectations) design using the observed growth.It is unclear how the Student growth percentile (SGP) and the targeted SGP expectation is calculated for 11th grade students (see Table 2.7). Here, WVDE does not provide a rationale for awarding large changes in the multiplier for some ranges.
Peers question whether defining effective as the 50 percentile rank (60 at the high school level) increases rigor (p. 84).
Technical Assistance Suggestions / WVDE should consider developing a clear communication strategy to explain two different ranking systems to stakeholders during rollout (i.e., State v. Federal).
2.A.i.bPeer Response