DESE Key Messages for MAP 2018
When new assessments are administered, results are not comparable with results from previous tests. In other words, they do not represent an “apples to apples” comparison, as the assessments in 2017-18 were completely different from previous tests.
- Due to changes in legislation and learning standards, Missouri has experienced four new tests in five years. Moving forward, year-over-year comparisons will be possible, and trends can be established.
- Missouri teachers and other stakeholders developed the Missouri Learning Standards that were adopted in Spring 2016. The new standards set a higher bar, which is reflected in more challenging, teacher-developed state assessments. We are proud of what the teachers and stakeholder groups created. In the long term, achievement is expected to increase.
- State assessments are an end-of-year measure of overall student performance across a district or charter school and are intended to evaluate the effectiveness of education programs, measure progress toward improvement goals, and, most importantly, to determine learning progress and achievement.
- While state assessments are not designed to guide classroom instruction during the school year, they can contribute meaningful information as part of a coherent system of assessments, including interim assessments administered by the school district.
MAP Results (Grade-Level and End-of-Course)
Here is the timeline for data release:
- MAP data release to districts via secure MCDS portal
- Assessment (MAP/EOC/MAP-A) appeals window opens
- Individual Student Reports (ISRs) available (see Assessment listserv message October 25, 2018) (Districts/charters distribute scores to parents/guardians)
- Deadline 5 p.m. for final assessment (MAP/EOC/MAP-A) appeals. No assessment appeals will be accepted after this date
- Deadline 5 p.m. for college and career readiness (CCR), attendance, and graduation corrections and appeals to appear in the preliminary APR
- Preliminary APR release to districts via secure MCDS portal
- Deadline 5:00 p.m. for final CCR, attendance, and graduation corrections and appeals to appear in the final APR
- Final APR release to districts via secure MCDS portal
- Final APR public release
MAP Cut Score Process
- More than 2,500 teachers have been involved in the development of the assessments, beginning with the writing of the learning standards.
- Whenever significant changes are made to tests, Missouri teachers and other experts establish cut scores to determine performance levels. In Missouri, districts have expressed reluctance to administer census field testing early in the school year because it would suspend at least two weeks of classroom instruction and result in double testing. Therefore, Missouri establishes cut scores after tests are administered.
- Establishment of cut scores include content, policy, and measurement science considerations.
- The process used by DESE meets the U.S. Department of Education’s peer review requirements and provided recommendations and information from a number of sources to inform the establishment of cut scores to determine performance levels.
Phase 1: Missouri teachers with current classroom experience studied the actual test items and information about what percentage of students responded correctly to each item. The group made the initial cut score recommendations.
Phase 2: Missouri school district and building, CTE, and higher education stakeholders considered the uses of test scores and their policy implications.
Phase 3: Missouri’s technical advisory committee reviewed the processes and results for technical quality.
- When the process was completed, 47 of the 51 cut scores initially recommended by teachers remained unchanged. Among the 17 assessments, 13 remained unchanged from the teachers’ bookmark recommendations.
- Four cut scores were adjusted based on additional feedback from the policy committee (Phase 2) and the technical advisory committee (Phase 3).
- Of the four assessments affected, only two are required: English II and Grade 7 ELA.
- For English II, the cut score adjustment did not add any students to below basic and did not remove any students from advanced. The adjustment was between proficient and basic, which increased the number in basic and decreased the number in proficient.
- For Grade 7 ELA, the cut score adjustment lowered the cut score for basic, thereby increasing the number of students in basic and reducing the number in below basic.
- Missouri teachers who participated were confident in the process and results, based on evaluations administered when the process was completed.
- At its September meeting, the State Board of Education asked for more input into the process. A series of public meetings generated that input, which was presented to the board in October. Gathering additional input further delayed results. DESE considered all the information, ideas, opinions and recommendations provided by these groups in regard to cut scores.
- The deadline for submitting data to USED is December 12, 2018.
- Implementation of the academic content standards adopted in spring 2016 will continue in the next couple of years.
- New science assessments will be administered in the 2018-19 school year. A field test was administered during 2017-18 MAP testing.
- New social studies assessments will be administered in the 2019-20 school year.
- The process to establish cut scores for each of the new assessments will be the same process used in 2017-18, a longstanding practice that has been well vetted and meets the federal requirements for peer review.