Data can be valuable, but it can also be manipulated--context is important as we strive to improve public education for all students.

Data doesn’t talk–people do


Data can be valuable, but it can also be manipulated--context is important as we strive to improve public education

It is worth focusing on the fact that there was a global pandemic ongoing. A pandemic that nobody saw coming, or that we had ever dealt with previously. Education was largely online, so that may point out why low-income, ELL students, and students of color did not have internet access or had difficulty accessing online school.

In addition, some students were still having an issue getting devices initially. The research period was over by the first semester and did not allow for adjustments that may have occurred. I am concerned about replicability in the study, and subsequent reliability. Even though it was a fascinating read with interesting thoughts, I am not sure I can go much beyond that at this time.

Professor Andrea Jones-Rooy brilliantly stated in Quartz: “Data doesn’t say anything. Humans say things. We’ve conflated data with truth. And this has dangerous implications for our ability to understand, explain, and improve the things we care about.” Data is important, but it can be manipulated and generated in the way questions are asked. The value is often suspect, and conclusions can be pre-determined.

Gavin Freeguard, using a similar theme, pointed out that, “badly presented data will be confusing to people inside government too. If we as the general public are having difficulty understanding messages across (and within) datasets, it suggests those inside government are having similar struggles. Indeed, making sense of the data is made nearly impossible by the sheer number of sources in use.”

In recent years, we have seen an overreliance on research from sole sources. In our state’s public education, much of the education research is done at Vanderbilt or Gates Foundation-funded research through various education nonprofits. That is not meant to be disparaging, but rather an observation.

However, the question we must ask ourselves is, “What is the possibility of the research being replicated or reproduced by other research institutions or organizations? Will the findings be the same?” We must recognize a susceptibility to biases in research. Bias can occur in the planning, data collection, analysis, and publication phases of research. Many biases work subconsciously, are undetectable, and ultimately not correctable. We must be aware of inconsistencies between actual results and preconceived expected outcomes.

This brings us back full circle. Was Vanderbilt’s research accurate and unbiased? Perhaps. Then again, the data may have been distorted by how the questions were asked or by some unforeseen bias. Who was the audience? Who paid for the research? What was the objective of the research? We all want to improve public education, but a little context on the findings would have been helpful—especially identifying the districts used in the study and identifying who paid for the research.

Too often media is off and running with stories about research without critical details. My friend happened to drill down and ask the tough questions. For too long we have been shallow when it comes to facts, and excellent when it comes to entertainment. Don Henley sings “Long Way Home,” which contains a great lesson: “There are three sides to every story–yours and mine and the cold, hard truth.” Such is with some research and news. It is up to all of us to determine what is true, and what is not. Data doesn’t talk, people do!

Want to share a great resource? Let us know at submissions@eschoolmedia.com.