Monday, February 17, 2020
US flag

Right after adoption, test scores on computer lower

A new study from the American Institutes for Research shows that Massachusetts students who took the PARCC tests online in the first year scored lower than their peers who took the paper-based versions of those tests, Education Week reports.


Performance on online versions of PARCC, beginning in Year 0 (2014-15)

The study was published this month in journal Economics of Education Review and considered data from the 2014-15 school year, the first year the state along with many others used tests developed by the Partnership for Assessment of Readiness for College and Career, or PARCC.

The report, while new, is consistent with previous studies that show a “mode effect,” and reported by Voxitatis here and here.

In Ohio, a survey of districts found that 85% of districts administering PARCC on paper received an “A” grade, compared to only 17% of online districts. In Illinois, 43% of students who took PARCC on paper scored proficient or above in ELA, compared to 36% of students who took the test online. In Maryland, middle school ELA students in Baltimore County scored worse on the online test after controlling for student background and prior achievement.

While previously noted differences might have resulted from differences among students, rather than a strict mode effect—although the statistical probability that there was “no” mode effect is near zero—the Massachusetts study took a different approach and looks strictly at the difference in mode of administration.

Their “estimates of mode effects in math and ELA represent extremely large changes in measured student learning: up to 5.3 months of learning in math and 11.0 months of learning in ELA in a 9 month school year,” authors Ben Backes and James Cowan write.

They note, however, that some of the loss in performance level from taking the test online is recovered in the second and subsequent years of test taking.

Paul Katula is the executive editor of the Voxitatis Research Foundation, which publishes this blog. For more information, see the About page.

Recent posts

Most detailed images ever of the sun

A new telescope at the National Solar Observatory snapped the most detailed pictures of the sun's surface we have ever seen.

Feds boost Bay funding

Restoration efforts in the Chesapeake Bay watershed received a boost in federal funding in the budget Congress passed last month.

Md. & IL bands perform on New Year’s in...

Bands from IL and Md. once again entertained thousands of people who lined the streets of London and Rome on New Year's Day.

Howard Co. sounds an under-staffing alarm

Teachers in a Md. district have filed a grievance over missing planning and lunch periods and, as a result, putting the most vulnerable students at risk.

Top 11 school stories of 2019

We find these 11 stories to have the greatest potential for influencing activity and direction in schools for the near future.

Girls’ volleyball champs in Illinois

We congratulate the Illinois state champions in girls' volleyball: Newark, St Teresa, Sterling, & Benet Academy.

A weekend of ‘band geeks’ across America

The musical Band Geeks was in performance at a MD high school, just as marching bands from across America named a national champion.

2 dead, 3 wounded in Calif. school shooting

Another school shooting has resulted in the death of 2 California high school students. The suspect shot himself and is in custody.

Mercury makes a transit; next in 2032

A transit of Mercury occurred today and was visible from the US, provided you had sunny skies. It was one of longest possible transits.

On the Naperville BWW racist incident

A racist incident at a Naperville, IL, sports bar indicates that the threads of racism are strong, perhaps as strong as ever.

IL bill could excuse absences to vote

A proposed law in IL could give students up to two hours during the school day so they could vote in the upcoming election.