Interpreting School Testing Data

Much is made of national results from the Program for International Student Assessment (PISA). I have often questioned the way results are commonly interpreted. Sharon Machlis points out several problems with these interpretations in her Computerworld blog. There are many reasons why some students do better than others on these exams. Schools and curricula are not the only reasons. There are many confounding factors. 

Even if one thing correlates with another, that does not mean either one is caused by the other. She cites the example that data show a strong correlation between ice cream consumption and drowning deaths in an area. Obviously, eating ice cream does not cause drowning. Both things are likely to happen when it’s hot outside.

Confounding factors in educational performance include parents’ educational level and income, she argues. See the chart she included to illustrate. It has the ten best performing districts and the ten worst performing districts on a Massachusetts standardized test. The poverty rates of the top ten districts are colored blue and the poverty rates of the bottom ten districts are colored red. The visual impact is striking with the top ten districts having much lower poverty rates. The chart was reposted from a blog post by Massachusetts State Senator Pat Jehlen, where there are other related graphs.

The PISA data is also based on projections of how a student would do if all the questions were answered on the test. This brings the results more into question for me.

Ms. Machlis concludes “But the bottom line here is this: You can’t assume that high test scores are caused by a certain type of curriculum, teaching methodology or education policy simply by looking at raw standardize test results.”

“Do things like curriculum, teaching methods and policies matter in educational outcome? Of course they do. But unless your testing data can factor out things like students’ family incomes and parents’ education levels, standardized test results won’t tell you.”

Right on.

December 9-13, 2013 is Computer Science Education Week

Computer Science Education Week promotes computer science in K-12 schools. The dates include the birthday of Admiral Grace Hopper on December 9 (born in 1906). Go to or for information and teaching and/or learning ideas. They would like all students K-12 to participate in an hour of code. 

Many people, myself included, support these goals. President Obama even has a video here.

“Aspirations in Computing” Award Application Due by October 31.

From Laura Dillon, MSU:

Don’t miss this opportunity for a young woman you know to be recognized for her aspirations!  The application is easy and the rewards are immense.  Read the personal stories of past AiC winners and how the award has changed their lives at

Please encourage high school women you know to apply.  Let them know that you want to endorse their application.  Your vote of confidence will mean a lot to them and give them the confidence to take the next step.  The deadline for complete applications is the end of this month.    A poster is attached.

Send any questions to

AiC poster2013.pdf

What Does Apple Plan to Cover?

Apple says “we still have a lot to cover” when announcing its October 22. People are wondering just what this means. It could mean they will be showing several new or enhanced products. I wonder if it might also mean they will be introducing special new covers for iOS devices. If the covers include a keyboard, most likely they will be for iPads and/or iPad Minis. Whatever they have in the offing, we only have a few days until we know for sure.

Today Show Show Supports Computer Science Education

The Today Show this morning had a segment with‘s Hadi Partovi on the importance of teaching Computer Science in our K-12 schools. See the Today Show video here.