dsib-adad-mar16item02

Page 1 of 7

California Department of Education
Executive Office
SBE-003 (REV.09/2011)
dsib-adad-mar16item02 / ITEM #03
/ CALIFORNIA STATE BOARD OF EDUCATION
MARCH 2016AGENDA

SUBJECT

California Assessment of Student Performance and Progress: Update on Program Activities, including, but not limited to, Smarter Balanced Assessments (Summative, Interim, and
Digital Library Resources), Technology, Summative
Assessment in Primary Languages Other than English, California Alternate Assessments, California Next Generation Science Standards Assessments, and Outreach Activities. / Action
Information
Public Hearing

SUMMARY OF THE ISSUE(S)

This item reflects the collaboration of the Assessment Development and Administration Division (ADAD), the Educational Data Management Division (EDMD), the Special Education Division (SED), and the Analysis, Measurement, and AccountabilityReporting Division (AMARD) of the California Department of Education (CDE) with regard to the California Assessment of Student Performance and Progress (CAASPP) System.

Update on Smarter Balanced Summative Assessments

On January 19, the Smarter Balanced Summative Assessments were made available to local educational agencies (LEAs) whose testing window indicated that summative testing could begin. As of January 29, 2016, the CDE estimates that 14 students started at least one test and 2 LEAs have started testing. The CDE will provide a verbal update on the summative annual administration.

2015–16 Weekend Hand Scoring Workshops for Smarter Balanced Summative Assessment Items

The purpose of the Weekend Hand Scoring Workshops is to provide a training and professional development opportunity for California educators who have applied and been approved to be paid hand scorers forthe Smarter Balanced Summative Assessments. The trainings will be grade span specific in order to provide the most relevant experience for participants. California educators who participate in the workshops will receive training in the use of the Online Network Evaluation (ONE) system used for live scoring and will beprepared to take thetestthat certifies them as California scorers for the Smarter Balanced Summative Assessments.The CDE will provide an update on the Weekend Hand Scoring Workshops (i.e.,dates and locations, number of applicants who are California teachers, number of participants who are California teachers, and number of certified scorers).

Update on the 2015–16 CAASPP Institute

The 2015–16 CAASPP Institute is a two-part in-person trainingthat givesschool district and school teams an opportunity to convene to: (1) develop strategies for using the complete CAASPP System to improve teaching and learning;(2) collaborate with colleagues within their LEA and with peers at LEAs within their region; and (3) receiveguided team planning time. Approximately 350 LEA teams representing approximately 1,800 staff members are participating in the CAASPP Institute.

Session one of the CAASPP Institute was conducted between September 2015 and February2016. Session two began on February 1, 2016, and will run through May 2016. Session two offers the opportunity for LEAs to reconvene to examine and share progress on the team plans that were created during session one of the Institute. Session two will be offered at 21 locations throughout the state. At each location, two regional LEAs will showcase their local plan to improve implementation of the CAASPP System as a resource for other LEAs and as a means for sharing information among session participants.

After the in-person trainings are completed, the content of the Institute will be video recorded in a training module format and made available on the CDE Web site. These video modules are expected to be available in June 2016. In addition, select LEAs will be identified to share, through more formal documentation, their local plans and progress on implementation.Diverseareas of focus will be represented in these plans (e.g., supporting English learners, ensuring identification of appropriateaccessibility supports, expanding use of interim assessments, etc.).

Update on Smarter Balanced Interim Assessments

Over 2.5 million interim assessments have been started across more than 1,000 California LEAs, including charter schools,during the 2015–16 school year, and 90 percent of those assessments have been completed. Of the interim assessments that have been started, 80 percent have been interim assessment blocks (IABs) and 20 percent have been interim comprehensive assessments (ICAs). The most popular interim assessment is the grade three, Operations and Algebraic Thinking.

This month, the CDE will release an updated Interim Assessment User Guidewhich will be available on the Interim Assessment Administration Resources page of the CAASPP Portal Web site at To further assist educatorsin using the interim assessments, and to supplement the Interim Assessment User Guide,the CDE has developed the Smarter Balanced Interim Assessment Video Series,which will be available in March on the CDE Interim AssessmentsWeb page at This five-part series of video modulesis intended to familiarize and train educators to effectively use the Smarter Balanced Interim Assessments, and contains demonstrations of the Interim Assessment Viewing System, Test Administrator Interface, Interim Assessment Hand Scoring System, and Interim Assessment Reporting System.The list of modulesand topics is as follows:

Module 1: Interim Assessment Introduction

Module 2: Interim Assessment Viewing System

Module 3: Interim Assessment Administration

Module 4: Interim Assessment Hand Scoring

Module 5: Interim Assessment Results

This summer, Smarter Balanced expects to release several new and updated IABs for mathematics and English language arts/literacy (ELA).Scheduled for releaseto Smarter Balanced member states are 14 new mathematics IABs and 21 new ELA IABs.For each content area, it is anticipated that two or three new IABs per grade will be released.CDE will work withthe CAASPP test contractor,Educational Testing Service (ETS), to prepare a timeline for integrating the new and revised IABsinto the Test Delivery System for use by LEAs. Further information regarding the new and revised IABs is expected in the coming months.

Update on Smarter Balanced Digital Library of Formative Assessment Resources

In January 2016, Smarter Balanced convenedmembers of the State Network of Educators (SNE) and State Leadership Team (SLT) from across Smarter Balanced member states to develop and vet newly-contributed formative assessment resources using quality criteria, identify Digital Library resources that link to specific IABs, and, as needed, review and revise resource tags. The SNE is a group of educators from Smarter Balanced member states who are trained to contribute to and review resourcesfor inclusion in the Digital Library. The SLT provides guidance and oversight to SNE members. Of the approximately 75 participants from across Smarter Balanced member states, 17 areCalifornia SNE members and 4 areCalifornia SLT members.

In June 2016, the CDE will host a collaboration workshop for California SNE members to develop formative assessment resources for inclusion in the Digital Library as well asgeneral resources that promote educator use of the Digital Library. Further details will be provided in the CAASPP Update item for the May 2016 State Board of Education (SBE) meeting.

Technology Update

The CDE continues to assist the K–12 High Speed Network (K12HSN) with the implementation of the Broadband Infrastructure Improvement Grant (BIIG) programs, which are designed to assist schools improve their connection to the Internet to administer computer-based assessments. In the first round of funding (BIIG 1.0) from the 2014–15 school year, there are 25that have data passing through their circuits. There are 30 additional sites with circuit installation waiting for equipment, and 117other sites with work in progress.

For additional information about the status of the remaining sites receiving upgraded connections from BIIG 1.0, please visit the K12HSN BIIG Circuit Installation Web page at (Note: If the preceding link does not display properly, copy and paste the Web address to a Web browser directly.)

The application deadline for BIIG 2.0 concluded on September 30, 2015, and as of November 16, 2015, 890 sites have been evaluated. Fifty-four of the 58 counties have at least one site included in the application phase,representing approximately 600 sites. Of these sites, 14 sites are Priority 1, which are sites that are unable to administer CAASPP assessments on their current network. An additional 200+ sites are Priority 2, which represents schools that have limited bandwidth for administering computer-based assessments. The remaining 400+ sites are Priority 3, which represents underconnected schools. Funding to Priority 3 schools will only be considered if funds are available. These applications are ranked by the lowest connection capacity. The bid process to solicit solutions for school sites in the application phase closed on December 14, 2015, in which more than 25 service providers submitted bids. Bids were reviewed and recommendations were submitted in late January. Evaluations of the bids, which included a Technical Peer Review and Stakeholder Review, took place in January and February 2016. Execution of contracts will commence in late March/early April 2016.

As of February 19, 2016, 22 sites have been approved to use paper-based versions of the 2016 CAASPP test administration, which includes approximately 1,000 students.

California Alternate Assessments

In February 2016, 60 teachers came together to review and revise the performance level descriptors (PLDs) for the California Alternate Assessment (CAA), whichwill be presented to the SBE in May 2016 for adoption. These PLDs follow the general PLDs approved by the SBE in January 2016. The PLDs will be used during the CAA standard setting later this summer, and results of the standard setting process will be provided to the SBE in fall 2016.

The 2016 CAA testing window is April 11 through June 17, 2016. Beginning in the 2016–17 school year, the CAA testing window will be the same window selected by LEAs to administer the Smarter Balanced Summative Assessments.

In preparation for the first operational test, Train-the-Trainer workshops were held in January and February 2016. Participantsreceived the information and skills necessary to go back to their LEAs and train test examiners to complete the one-on-one administration of the 2016 CAAs. It is anticipated that over 6,000 test examiners will be trained in 2016.

In late February, the CDE was pleased to announce the posting of a CAA video. This video was produced in cooperation with the San Joaquin County Office of Education and with special assistance from ETS. The video communicates California’s transition from the California Alternate Performance Assessments (CAPA) to the new CAAs. LEAs have shared the link with parents and advocates throughout their sites in an effortspread the message before the testing window opens in April.

California Next Generation Science Standards Assessments

An update on the development of the California Next Generation Science Standards (CA NGSS) summative assessments and the expansion of science assessments are included in two separate SBE items.

Successor Primary Language Assessment

The CDE continues its efforts to communicate and refine the proposed purpose of the successor primary language assessment by meeting with internal CDE staff and with external stakeholders in the development of the draft purpose for the successor to the Standards-based Test in Spanish (STS). The CDE and ETS received additional input from the CAASPP technical advisory group in early February and ETS continues to work with its team of national experts in the development and support of the proposed purpose and a draft test design. In May 2016, the CDE intends to bring to the SBE, the proposed purpose for approval and the draft test development plan.Test blueprints will be submitted for approval in late summer or fall of this year.

RECOMMENDATION

This item is for information only. No specific action is recommended at this time.

BRIEF HISTORY OF KEY ISSUES

Per CaliforniaEducation Code (EC) Section 60640, the CAASPP System succeeded the Standardized Testing and Reporting (STAR)Program on January 1, 2014.

SUMMARY OF PREVIOUS STATE BOARD OF EDUCATION DISCUSSION AND ACTION

In January 2016, the CDE provided the SBE with an update on the CAASPP activities. (

In addition, the CDE presented the CAASPP Student Score Reports for approval.

( and

Lastly, the SBE approved the General PLDs for the CAAs. (

In December 2015, the CDE provided the SBE with two Information Memoranda on the Conducted and Planned Studies of the Validity, Reliability, and Fairness of the California Assessment of Student Performance and Progress System( and an Update on the Successor Primary Language Test.(

In November 2015, the CDE provided the SBE with an update on the various CAASPP activities on the enhancements to the test delivery system, regional trainings held throughout the state, and an Early Assessment Program presentation by Carolina Cardenas, Director, Academic Outreach and Early Assessment.

(

(

In October 2015, the CDE provided the SBE with two Information Memoranda on the CAASPP post-test survey and focus group results and the CAASPP 2014–15 Summative Assessment reports.

(

(

In September 2015, the CDE provided a pre-release CAASPP briefing to the SBE including a preview of the new public reporting Web site to report the results for the ELA and mathematics assessments. The CDE also announced the posting of the Parent Guide to the Smarter Balanced Summative Assessments,Overview and Sample Questionsfor three grade spans (three through five, six through eight, and eleven). These guides are posted on the CDE CAASPP Web page under the Students and Parents tab at (

(

(

In August 2015, the CDE provided the SBE with an Information Memorandum on the California Assessment of Student Performance and Progress: Summary Results from Teacher and Student Feedback Sessions. (

(

In June 2015, the CDE provided the SBE withan Information Memorandum on the CAASPP pre-test survey results and an update on the stakeholder meeting for CA NGSS assessments required by the Elementary and Secondary Education Act.

(

(

FISCAL ANALYSIS (AS APPROPRIATE)

The 2015 Budget Act provides $50 million for the K–12 High Speed Network (K12HSN) for the Broadband Infrastructure Improvement Grants (BIIG) program grants for LEAs and $10 million for the K12HSN professional development and technical assistance activities.

The 2015 Budget Act also provides $94 million in funding for CAASPP contract activities in 2015–16. This funding is being utilized for the following CAASPP contracts:

  • Contract activities provided by ETS ($83.6 million: $7.6 million in Contract 5417; $76 million in CN150012) were approved by the SBE for test administration and development activities, including the development of CA NGSS and primary language assessments per SBE input
  • A contract with the University of California, Los Angeles ($8 million) was approved by the SBE for Smarter Balanced consortium-managed services, including access to the Smarter Balanced Summative Assessments, Interim Assessments, and Digital Library tools
  • A contract with the Human Resources Research Association ($774,117) for a multi-year independent evaluation of the CAASPP System per requirements in California EC Section 60649
  • A contract with the Sacramento County Office of Education ($1.5 million in one-time funding) for CAASPP support activities, including regional CAASPP Institutes and Senior Assessment Fellows services per authority in the 2015 Budget Act (6100-113-0001, Provision 13)

Funding for 2016–17 and beyond will be contingent upon an annual appropriation being made available from the Legislature in future fiscal years. The proposed Governor’s budget for 2016–17 includes $93.03 million for ongoing costs for the CAASPP contracts listed above. However, the proposed budget does not include ongoing funding for the Senior Assessment Fellows services.

ATTACHMENT(S)

Attachment 1:California Assessment of Student Performance and Progress Outreach and Professional Development Activities (9 Pages)

9/13/2018 10:03 AM

dsib-adad-mar16item02

Attachment 1

Page 1 of 9

California Assessment of Student Performance and Progress Outreach and Professional Development Activities

The California Department of Education (CDE), in coordination with its assessment contractor and CDE Senior Assessment Fellows, have provided a variety of outreach activities to prepare local educational agencies (LEAs) for the administration of California Assessment of Student Performance and Progress (CAASPP) System. Outreach efforts have included Webcasts, in-person test administration workshops, focus group meetings, and presentations for numerous LEAs throughout the state. The following table lists presentations during Januaryand February2016. In addition, the CDE continues to release information regarding the CAASPP System, including weekly updates, on its Web site and through e-mail Listservs.This table will be updated at a later date.

Advisory Panel/Review Committee Meetings
Date / Event Location / Assessment / Estimated Number of Attendees / Description
2/8/16–2/12/16 / Sacramento / California Alternate Assessment (CAA) / TBD / Content Reviews for CAA Performance Level Descriptors (PLDs) Development.
2/11/16–2/12/16 / Sacramento / CAASPP System / TBD / CAASPP Technical Advisory Group.
2/24/16–2/25/16 / Sacramento / CAASPP System / TBD / Advisory Commission on Special Education Meeting.
Webcasts
Date / Assessment / Estimated Number of Attendees / Description
1/14/16 / Smarter Balanced / 314 / Webcast to prepare LEAs to administer the Smarter Balanced assessments.This Webcast is archived on the CAASPP Archived Webcast Web page at
1/14/16 / CAA / 238 / Webcast to prepare LEAs to administer the CAA.This Webcast is archived on the CAASPP Archived Webcast Web page at
2/24/16 / Summative / TBD / CAASPP Test Security and Irregularities.
In-Person Regional Trainings
Date / Event Name / Event Location / Estimated Number of Attendees / Description
1/6/16 / CAASPP Pretest Workshops / Sacramento / 146 / In-person workshops conducted across the state to train LEA CAASPP coordinators on how to administer the Smarter Balanced assessments and the CAAs. LEA CAASPP coordinators were offered the opportunity to invite one additional representative from their LEA to attend these workshops.