“Data dashboards can be very beneficial if we’re using them in conjunction with other means of assessment,” he said, “such as formative assessment, portfolio assessment, and performance assessment.” If not, “then we’re making a huge mistake.”
Anderson also is wary of dashboards that claim to predict how well a student will do.
“When you start to rely on algorithms that tell you how students are going to achieve, there’s an inherent risk in that,” he said. “We’re only looking at one small piece of information, but there are so many other factors that affect student achievement. We’re not taking into account any of the other things that are happening in the classroom, or socioeconomic status, or parent involvement.”
Those non-academic factors are critical to School District 73.5 in Skokie, Ill. The district has created what it calls a Student Skills Rubric that measures factors such as how prepared students are for class, whether they are on time, how committed they are to learning, and how well they work with others.
“There is more to students than just academic data,” said Lisa Westman, a former teacher who is now an instructional coach helping District 73.5 educators differentiate their instruction. “There is affective data and student skills data, and data about how students learn best. If students feel safe and comfortable and connected to a teacher, they will succeed. For students to feel that way, they need to be taught in a way that works for them.”
The district is piloting a data dashboard called the Otus Student Performance Platform, created by two Chicago-area teachers—and the system is flexible enough to incorporate data from the custom-designed Student Skills Rubric, so teachers and administrators can see how students measure according to these factors in addition to more traditional academic ones.
The system “integrates all of our data,” Westman said, including formative and summative assessment results, third-party assessment data such as the Northwest Evaluation Association’s Measures of Academic Progress or PARCC results, and the students skills and participation data.
Having all of this information available in a single dashboard is extremely helpful for educators, she said, and it leads to richer, more productive conversations among staff.
“It is of utmost importance to look at all of our students as multidimensional individuals,” she said. “I honestly believe there are no students who cannot achieve success; it’s just a matter of looking at the right information and then putting those puzzle pieces together in the right way. A data dashboard helps you to put those puzzle pieces together in a way that makes sense.”
Other essential characteristics
An effective data dashboard not only should contain information from several different sources and be flexible enough to incorporate both academic and non-academic factors—it also should provide insight into both larger trends and small details, Westman said, such as which discrete skills students need help with.
Above all, it must be easy to use.
“It needs to be teacher-friendly,” Teamann said. “If it requires entering information and then converting it and applying it in a different manner, that’s three steps you don’t need. Teachers aren’t statisticians, and they aren’t mathematicians. They’re working with kids. I want that to be as easy as possible for them.”
Data dashboards are only as effective as the information they contain, she added, and educators should not over-rely on them.
“Data tells a story, if you have enough data points. But I also never take for granted my teachers’ eyes and opinions,” she concluded. “There may be more to the story than what that child scored on his last two assessments. It’s important for teachers to have input as well.”