- eSchool News - https://www.eschoolnews.com -

Can young students master digital writing assessments?

writing-pilot

How did young students perform with a computer-based writing assessment pilot?

A new pilot study reveals that fourth grade students are well-equipped to successfully take computer-based writing assessments.

The National Center for Education Statistics conducted the National Assessment of Educational Progress (NAEP) Grade 4 Writing Computer-Based Assessment (WCBA) study to determine if fourth-grade students were in fact able to effectively use computers to complete a writing assessment.

“We found that fourth-graders were able to organize and convey their thoughts well enough to be assessed against the NAEP rubric,” said Cornelia Orr, executive director of the National Assessment Governing Board, during a webinar briefing that addressed the results.

Results showed that students typed enough words to enable evaluators to evaluate their writing skills, she added.

“The significance of writing right now is something that we have to hold onto, and because of that, the notion of what it means to prepare young people as writers is ever more significant,” said Elyse Eidman-Aadahl, executive director of the National Writing Project. Eidman-Aadahl served as a member on the 2011 NAEP Writing Framework committee.

(Next page: Results from the writing pilot test)

“For most people right now, they will be writing in a digital environment, and certainly for fourth graders, they’re growing into a world where our interactions are in a digital environment,” she said.

In fact, moving writing assessments to a digital platform has increased relevance for young students today.

“Writing in a computer-based environment is part of the construct of what writing is–so looking at how young people are able to move into, with comfort, writing in a digital framework both tells us something about the move toward putting more assessment opportunities into the computer, but it also tells us something extremely significant about preparing young people to be writers at all–because to be a writer today is to write in digital environments,” Eidman-Aadahl said.

The study [1] consisted of two parts:

  1. Small-scale usability testing to improve development of the assessment platform for fourth-grade students
  2. A pilot writing assessment administered to a sample of 13,000 students nationwide

The pilot examined students’ ability to organize and write typed responses to prompts, with each prompt accompanied by either 30 minutes or 20 minutes of writing time.

Students with 30 minutes of writing time were scored on a 6-point rubric, with 1 being the lowest and 6 being the highest.

Thirty-nine percent of students received a 1 or a 2, indicating little to no marginal writing skills; 47 percent of students received a 3 or 4, indicating developing or adequate writing skills; and 14 percent of students received a 5 or 6 and demonstrated competent or effective writing skills.

The average word count was 110 words per response. Thirty-one percent of students typed 1,001 keystrokes or more, and 71 percent of the highest-scoring student responses used 1,001 keystrokes or more, compared to 9 percent of the lowest-scoring responses.

Fifty-five percent used the backspace key fewer than 100 times, and 39 percent of students used the spell check tool at least four times.

When writing for different purposes:

The usability study helped to inform the pilot assessment administered to students nationwide.

A number of lessons emerged from those usability tests, including:
1. Simplifying directions will help students understand the objective.

2. Tools should be easy to locate and well-labeled