Wednesday, September 23, 2020
US flag

NAEP reports state-level scores on science test

US fourth and eighth graders have made gains in science, on average, and large racial achievement gaps have narrowed slightly, according to the results of a national science test released today, the Washington Post reports.

You can examine the scores nationally, for Illinois, for Maryland, or any state, and see that girls made bigger improvements than boys on the science test nationwide, resulting in a slight narrowing of the gender gap for eighth graders and completely nullifying any statistically significant gap between fourth-grade girls and boys.

NPR questioned whether NAEP actually measures anything important.

Although US Secretary of Education John King was quoted as saying, “All of this means that more students are developing skills like thinking critically, making sense of information and evaluating evidence,” Carl Wieman, a Nobel Laureate who teaches in Stanford University’s physics department and Graduate School of Education, said he took a look at some of the sample questions used on the science test and found many of them to be shallow in that they asked for simple recall of terminology or facts.

Since both Maryland and Illinois have adopted the Next Generation Science Standards, students in those states should be taught to think more deeply about science than simply recalling facts. Here’s a NAEP technical report on the NGSS. The NAEP questions aren’t as bad as those used by some states, though. “I’ve seen worse,” he told NPR. “A lot worse.”

For example, a sample item on the eighth-grade test asks students to draw and label a diagram showing each of the following: Earth, Mercury, Sun, Orbits.

In simple recall questions like that, “There is no concept at all of where a student might be able to use those facts or have any relevance in anyone’s life, which for me is kind of more meaningful measures of learning,” Mr Weiman said. If most of the questions on the test were like the samples, the test doesn’t measure the relevant aspects of science education.

Let me give you a quick explanation of why new standards need to be assessed. It’s a really short explanation: technology.

“OK Google,” I say into my phone. “What are the products of photosynthesis?”

A pleasant female voice replies, “According to, the main product of photosynthesis is glucose. Oxygen is mainly a byproduct of the process of photosynthesis. Six molecules of carbon dioxide and six molecules of water are needed to produce one molecule of glucose.”

My smartphone did a better job of answering the question than a straight-recall test, like the NAEP, would have done, even doing the stoichiometry a little. There’s no point in making students memorize the products of photosynthesis for a test anymore, and what our tests need to measure is how students can apply knowledge of these trivial factoids to make them relevant in someone’s life. That’s what science teachers are teaching.

Local results

Although the NAEP, or National Assessment of Educational Progress, is intended for tracking the progress students make over time, even across decades, that purpose requires that the test remain essentially the same over time.

It is also able to examine performance of students at the state level and by certain subgroups of students within those states, but with those comparisons as well, the scores reflect the knowledge and skills that are incorporated into the questions that make up the test. As shown, that is mainly simple recall, which isn’t how US schools teach science anymore.

In Maryland, scores for eighth and fourth graders weren’t significantly different from the national average.

Illinois students scored below the national average on the eighth-grade science test in 2015, but the percentage of students who scored at or above the proficient level went back up a little bit, from 26 percent in 2011 to 28 percent in 2015, which was the percent at or above proficient in 2009. Fourth graders in Illinois didn’t score significantly different from the national average.

Participation in the NAEP was voluntary; scores weren’t reported for Alaska, Colorado, Louisiana, Pennsylvania, or the District of Columbia.

Paul Katula is the executive editor of the Voxitatis Research Foundation, which publishes this blog. For more information, see the About page.

Recent posts

How citizens prefer to fund environmental action

Growing demand for countries to combat climate change, less consensus on how to fund it. New study offers insight from the US, UK, Germany, France.

Student news roundup, Illinois, Sept. 21

The death of The Notorious RBG, foreign exchange student from France, live streaming plays, BLM, and (of course) remote learning.

Fewer kindergartners, more college drop-outs

The nation has experienced an increase in college drop-outs, esp. among low-income families, and an explainable decrease in kindergarten enrollment.

Tim Kaine talks to Fairfax Co. seniors

In Virginia, protesters intimidated citizens at an early voting center in Fairfax Co. Sen. Tim Kaine talks about voting to students.

Obituary: Justice Ruth Bader Ginsburg

The death of Supreme Court Justice Ruth Bader Ginsburg is certain to bring a political battle between the president, the Senate, and Democrats.

Students help in wake of Gulf Coast storms

Hurricane victims in the South got some much needed help from students at one Louisiana school. Laura and Sally have been very destructive.

Scientific American endorses a candidate

It's rare that a science journal would endorse a presidential candidate, but it has happened, due mainly to Pres. Trump's rejection of science.

Student news roundup, Maryland, Sept. 16

The pandemic reveals much more about us than our unpreparedness for virtual learning; Md. students look at healthcare and choices about schooling.

Smoke from Calif. paints the East Coast sun

The sunrise this morning in Baltimore and Chicago was cooled by smoke from the Calif. wildfires, which created a thick haze aloft.

Student news roundup, Illinois, Sept. 14

Special ed advocate in Evanston dies; Remembering 9/11; Business, fine arts, and cultural life during the pandemic.

No, the president can’t run for a 3rd term

The 22nd Amendment limits the number of times a president can be elected to two. But maybe Constitutions mean little to the current administration.