Step 2: Connecting interventions to our data
Now that we were collecting the right data to isolate the instructional areas MVUSD students were ready to tackle, we needed to provide our teachers with additional resources to help them differentiate instruction. Teachers can use MAP data to identify common pain points to inform their lesson plans, but the granular data allows us to personalize learning even further. We know the specific topics students need to close skill gaps, but with an average class size of 24, it can be difficult to find the time for one-on-ones with each student.
As a district, we sought out the interventions that could take MAP growth data to the next level. I think the best example is the one-to-one online tutoring program we provide to students who scored a level 1 or level 2 on their math CAASPP.
We worked with FEV Tutor, who took individual students’ fall RIT scores (grade-level equivalences) to create personalized tutoring plans for each student. Depending on the school site, students worked one-on-one with their own professional tutor during the day or at an after-school program. All tutoring was online, and since it was one-to-one, students could work through the specific learning strands identified on their learning plan with the support of a live instructor.
Each online tutoring session concluded with an exit ticket. Teachers and administrators saw this data on a weekly basis, which allowed our teachers to see—in real time—how their students were progressing through their learning plans. If students were continuing to struggle, it was a warning that students would not likely reach their projected growth goals for the year and that we should explore additional interventions.
At the end of the tutoring program, the team at FEV Tutor did a full analysis to examine the impact. In academic year 2016-2017, MVUSD set a district-wide goal for 50 percent of all students to meet or exceed their fall to spring MAP Growth goals. We are pleased to share that 69 percent of FEV Tutor participants met or exceeded their fall to spring MAP Growth goals in math, compared to 17 percent of students who were identified for tutoring but did not participate.
Step 3: Connecting data points
MAP Growth is a great sign of students working their way toward proficiency; however, it is important to match this data into overall student performance. To try and get a clearer picture of the impact online tutoring had on student achievement, MVUSD’s department of accountability and assessment worked with FEV Tutor to examine the impact that online tutoring had on the CAASPP.
We saw that students who participated in FEV tutoring grew by an average of +26 scale score points from the spring 2016 CAASPP to the spring 2017 CAASPP, compared to +22 points for non-FEV Tutor participants. By taking a deeper dive into the data we found that, across the district, students who participated in 10 or more tutoring sessions had the highest rate of performance-level movement. For students that took 10 or more sessions, the percentage who scored a level 3 (standard met) or level 4 (standard exceeded) grew by 15 percentage points from the spring 2016 to spring 2017 CAASPP. The percentage of students who scored a level 2 (standard nearly met) grew by 13 percentage points. This 13-percent increase is specifically significant at MVUSD because most students who participated in the FEV tutoring program scored a level 1 (standard not met) on the 2016 CAASPP.