The Edvocate

Top Menu

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Pedagogue
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Post a Job
  • AI Powered Personal Tutor

logo

The Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Pedagogue
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Post a Job
  • AI Powered Personal Tutor
  • 18 Ways to Encourage Pessimistic Students

  • E-learning Localization: Everything You Need to Know

  • Interesting Essay Topics To Write About, Do Androids Dream of Electric Sheep?

  • DNA Essay Topics

  • Distance Education Essay Topics

  • Dispute Resolution Essay Topics

  • Interesting Essay Topics To Write About Disorders

  • Disneyland Essay Topics

  • Disabilities Topics for Research Papers & Essays

  • Diet Essay Topics

Testing
Home›Testing›Here’s how the method of testing can change student scores

Here’s how the method of testing can change student scores

By Matthew Lynch
September 17, 2016
0
Spread the love

Steve Graham, Arizona State University

Students who recently took the Partnership for Assessment of Readiness for College and Careers (PARCC) scored lower when they took the test on a computer than when they used paper and pencil.

This might not matter much if the results of these tests played a minimal role. But they do not. Test scores are used for accountability purposes at the federal, state and local level. In some states, test scores play a role in student graduation and the evaluation of teachers and principals.

The question is, does the method of test taking actually influence test results?

I have been researching factors that influence test performance when students write essays. Such essays are written with paper or pencil or on a computer. Based on research that I coauthored in 2011, the answer to this question is yes. But there are several caveats.

In contrast to the findings from the PARCC test, we found that students writing on a computer scored higher than students writing with paper and pencil. This finding did not apply to all students, though. Students with little experience using a computer to write had higher scores when writing by hand.

Computer versus pencil-and-paper tests

In the last five years, two partnerships of U.S. states funded by the federal program Race to the Top were tasked with developing assessments for determining if students were on track or ready for college and the world of work.

The consortia developed computer-based assessments that, among other things, would make scoring easier, sharing results faster and conducting assessments cheaper. Many, but not all states, agreed to use these tests to assess students’ academic progress in multiple grades across the school years.

For tests developed by one of the consortia, Partnership for Assessment of Readiness for College and Careers (PARCC), students obtained higher scores in English/language arts on the paper pencil version versus the computer one.

By contrast, I obtained very different results in my review of seven scientific studies of factors that influence test results. Students’ writing performance on computer assessments was 21 percentile points higher when compared to students who wrote via paper and pencil.

But then, another review I conducted of 18 scientific studies found the same 21 percentile advantage for writing when students used computer for writing in the classroom.

Computer-based assessments

So why are there differences between PARCC tests results and the finding from scientific studies I reviewed? A likely explanation involves students’ experience with the method of testing.

Computers can underestimate writing achievements.
Samuel Mann, CC BY

My review of four scientific studies showed that students with little experience using computers as an assessment tool scored 18 percentile points lower than when they composed their essays using paper and pencil.

In other words, a student’s mastery of the method of testing matters. For students with little experience, computer assessments underestimate their writing achievement.

To get a sense of how method of testing can influence writing performance, imagine you are asked to write something for a test using a Chinese typewriter. This is a very complex writing tool designed to create 6,000 characters. Top typing speeds are 11 characters per minute.

Even if you reach this benchmark, you will have no hope of typing fast enough to get all your thoughts down on paper before some of your ideas slip from memory. If you are not proficient with this typewriter, then the problem is even worse. As you hunt for the next character, your memory is taxed even further, resulting in even more ideas being lost.

As this example illustrates the method of testing can interfere with a students’ performance. If a student is not adequately familiar with the testing tool or it is cumbersome to use, time and energy most be devoted to using it.

This is time and energy that can profitably be devoted to answering test questions.

Pencil-and-paper assessments

These kinds of problems are not limited to tests taken on a typewriter or computer, they can occur for paper-and-pencil tests too.

Students handwriting is not always fast enough for them to record all of their ideas before some of them slip from memory. This is a problem even for college students.

In a study with University of London undergraduates, handwriting fluency accounted for 40 percent of the variance in their scores on a timed-essay writing test.

Legibility of response can influence results on a pen-and-paper test.
Dennis S. Hurd, CC BY-NC-ND

With paper-and-pencil tests, there is an additional complicating factor. Scores on handwritten tests can be influenced by the legibility of the response. Test responses that are less legible can drop scores by 35 percentile points compared to the same response that is written neatly and legibly.

Making the matter even more complicated, a typed paper is scored more harshly than the same handwritten paper.

In a review of five scientific studies, I found that the score for a typed version of a handwritten text dropped by 18 percentile points. According to teachers involved in these studies, spelling and grammar errors were more visible in typed versus the handwritten version of the same paper.

So, method of testing makes a difference in the following ways: if students are not adept at taking a test on a computer, they score higher on the same paper-and-pencil test. If they are adept with a computer, they score higher on the computer test. Students performance is further moderated by handwriting fluency and legibility on paper-and-pencil tests and the number of spelling and grammar errors on computer tests.

Why use digital tools

What testing methods should schools use? Should computer-based assessments be abandoned, in view of recent PARCC results?

In the best of all possible worlds, students should be allowed to use the method of testing they are most proficient with when taking tests. However, this is unlikely to happen as it adds another level of complexity and costs to test taking. So, one alternative for groups like PARCC is to statistically adjust scores to reflect the differences between test taking modes.

Abandoning computer-based tests would be a mistake. These assessments have the potential to move schools from 19th-century writing tools to 21st-century tools.

As high-stakes assessments go increasingly digital, schools will make word processing and other digital composing tools a common staple. Studies have shown that students who use such tools over time become better writers than those who continue to write with paper and pencil.

At the end of the day, testing must produce something positive. Better writing tools in the classroom would be a step in the right direction.

The Conversation

Steve Graham, Professor of Leadership and Innovation, Arizona State University

This article was originally published on The Conversation. Read the original article.

TagsedchatEdtechEducationelearningk12ntchatSTEMteachered
Previous Article

Need PR Services or Marketing Services for ...

Next Article

Reforming College Debt, Part II: Possible Solutions

Matthew Lynch

Related articles More from author

  • STEM

    My Vision For the Future of STEM Education

    June 27, 2018
    By Matthew Lynch
  • STEMTrending Topics

    21 Amazing STEM Resources for Teachers

    June 18, 2017
    By Matthew Lynch
  • Matthew LynchTeachers

    3 Responsibilities Teachers Have (Besides Teaching)

    November 21, 2015
    By Matthew Lynch
  • EdTech & InnovationEquity

    The tech divide: An opportunity gap schools must close

    February 21, 2016
    By Matthew Lynch
  • First Year TeachersTeachers

    The First Year Teaching: Resolving classroom conflict

    October 31, 2016
    By Matthew Lynch
  • Ask An ExpertMatthew LynchTeachers

    Here Are 4 of My Thoughts on Whether Universal Pre-K is Necessary

    January 10, 2016
    By Matthew Lynch

Leave a reply Cancel reply

Search

Registration and Login

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Subscribe to The Edvocate Podcast

Apple PodcastsGoogle PodcastsAndroidby EmailRSS
  • Recent

  • Popular

  • Comments

  • 18 Ways to Encourage Pessimistic Students

    By Matthew Lynch
    January 27, 2023
  • E-learning Localization: Everything You Need to Know

    By Matthew Lynch
    January 27, 2023
  • Interesting Essay Topics To Write About, Do Androids Dream of Electric Sheep?

    By Matthew Lynch
    January 26, 2023
  • DNA Essay Topics

    By Matthew Lynch
    January 26, 2023
  • Distance Education Essay Topics

    By Matthew Lynch
    January 26, 2023
  • 18 Reasons the U.S. Education System is Failing

    By Matthew Lynch
    April 3, 2017
  • The Top 5 Unexpected Benefits of Early Childhood Education

    By Matthew Lynch
    February 29, 2016
  • 7 Benefits of STEM Education

    By Matthew Lynch
    January 12, 2019
  • What is Culturally Responsive Pedagogy?

    By Matthew Lynch
    April 21, 2016
  • pass or fail

    Black Boys in Crisis: Why Aren’t They Reading?

    By Matthew Lynch
    January 16, 2017
  • School Evaluation For Special Education What Parents Need to Know
    on
    December 27, 2022

    A Guide to Norm-Referenced Tests

    […] Norm-referenced tests – ...
  • Effectively Educating Diverse Student Populations: Strategies That Work - Applead Hofu
    on
    December 21, 2022

    6 Ways to Implement a Real Multicultural Education in the Classroom

    […] as to successfully ...
  • The Importance Of Sight Words In Early Reading – GoGreenva.org
    on
    December 21, 2022

    Understanding Letter Recognition and It’s Role in Preliteracy

    […] between letters, numbers, ...
  • Online Education in Chennai - Birla Brainiacs
    on
    December 20, 2022

    The Advantages and Limitations of Homeschooling

    […] Online Education in ...
  • Advancing Technology Education in Rural High Schools Across ... - The Tech Edvocate - VSAY .IN
    on
    December 20, 2022

    7 Ways Technology Is Impacting Modern Education

    […] technology advancements have ...

Ask an Expert

  • Ask An Expert

    How Dumbed Down Education Is Creating a National Security Crisis

    Spread the loveFor the past few decades, our country’s educational system has seen both struggle and tremendous change. With the various ailments plaguing our educational system, education reforms have attempted ...
  • Ask An Expert

    21 Inspirational Quotes That Nelson Mandela Made About Education

    Spread the loveWe all have our heroes. Those human beings that seem larger than life and almost achieve Godlike status. One of my heroes is the late-great Nelson Mandela, who ...
  • Ask An ExpertAssistive TechnologyCareer ReadinessChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEducation LeadershipElementary EducationElementary SchoolEquityFirst Year TeachersFreshHigh SchoolK-12Middle SchoolModern ParentingParent & Family TechParental InvolvementParentingPersonalized LearningPodcastPolicy & ReformPreK-12Special EducationSTEMTeacher EducationTeachers

    The Edvocate Podcast, Episode 7: How Digital Age Teachers Can Win Over Parents

    Spread the loveEducation is a collaborative process, as it takes many stakeholders working in unison to help students succeed academically. One of the most integral parts of this collaborative team ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...

International Education

  • Education FoundationsInternational Education

    4 Reasons You Should Study Geography

    Spread the loveUsually, people are under the wrong impression that geography does not offer many job opportunities, and there are no jobs for a geographer. They think that studying geography ...
  • International Education

    How International Baccalaureate (IB) Programs Work

    Spread the loveThe International Baccalaureate Program is a very intensive pre-college program in which when students get involved, they get college credit. Unlike most other learning initiatives, this program deeply ...
  • International Education

    Globalization: Everything You Need to Know

    Spread the loveGlobalization is the growing interconnectedness of countries around the world. It involves increasing communication and various forms of interaction between people of different nations, ethnicities and cultures. There ...
  • AssessmentEducation LeadershipHigher EducationInternational EducationProfessional DevelopmentTeachers

    So You Want to Attend Graduate School: The 411 on Grad School Admissions Tests

    Spread the loveApplying for admission to professional and graduate schools is no less competitive than college/undergraduate admissions. If you’re planning to pursue a degree in business, law, medicine, or graduate ...
  • Higher EducationInternational Education

    What Extracurricular Activities Impress Colleges the Most?

    Spread the loveWhen you apply to schools that offer holistic admissions or apply to a college using the Common Application, you will have to describe your participation in extracurricular activities. ...

Early Childhood Education

  • Early ChildhoodTeachers

    20 Strategies to Encourage Students to Take Care of their Personal Property

    Spread the loveAre you looking for strategies to encourage students to take care of their personal property? If so, keep reading. 1. Praise the learner for appropriate care of personal ...
  • Early ChildhoodTeachers

    14 Strategies to Teach Students Appropriate Mealtime Manners

    Spread the loveAre you looking for strategies to teach students appropriate mealtime manners? If so, keep reading. 1. Praise the learner for demonstrating appropriate mealtime behaviors: (a) give the learner ...
  • Child DevelopmentEarly Childhood

    22 Strategies to Help Students Who Cannot Fasten Their Own Clothes

    Spread the loveAre you looking for strategies to help students who cannot fasten their own clothes? If so, keep reading. 1. Select a peer to model fastening pieces of clothing ...
  • Critical Thinking and CreativityEarly Childhood

    14 Ways to Teach Kids to Improve Their Critical Thinking Skills

    Spread the loveAre you looking for ways to teach kids to improve their critical thinking skills? If so, keep reading. 1. Establish a time each day for a problem-solving game, ...
  • Early ChildhoodReading Education

    Echo Reading: Everything You Need to Know

    Spread the loveEcho reading is a reading tactic employed by adults when teaching children. Here, the adult articulately reads out a portion of text, following which the child echoes the ...

Gifted and Talented Education

  • Gifted and Talented Education

    Twice-Exceptional: What Does it Mean?

    Spread the loveTo be twice-exceptional is to be exceptionally gifted in some academic aspects while being below average compared to peers in other aspects. As a matter of fact, such ...
  • Gifted and Talented Education

    A Guide to Talent Search Programs

    Spread the loveThe Talent Search Initiative has as its aim; the identification of high-performing students by organizing specific tests. Different avenues are then provided for these students to channel their ...
  • Gifted and Talented EducationK-12

    Homogeneous Grouping: What You Need to Know

    Spread the loveThis term refers to the grouping of students by mental capability, aptitude, or hobbies. For instance, gifted students are placed in one group, and students with special needs ...
  • Gifted and Talented Education

    Cluster Grouping: What You Need to Know

    Spread the loveThis term describes a manner of classifying gifted students to place them in properly segmented classrooms. For example, about five to seven extremely bright pupils with comparable skill ...
  • Gifted and Talented EducationHigher Education

    Merit Scholarships: Everything Your Need to Know

    Spread the loveThese are monetary gifts awarded by institutions to superbly gifted students, who have set themselves apart by their exceptional performance in schoolwork, regardless of whether they require the ...

Black Boys in Crisis Series

  • Black Boys in Crisis

    The Importance of Mentoring Young African-American Males

    Spread the loveTeachers need to realize that at home, in their neighborhoods, and in school, many students face difficulties that can interfere with learning. Compared to their middle-class counterparts, it ...
  • Black Boys in CrisisDiversityEquity

    7 Ways That Black Students are Discriminated Against in U.S K-12 Schools

    Spread the loveAfrican Africans have a long history of being mistreated in the United States, starting with slavery. It should come as no surprise that their children face the same ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...
  • Ask An ExpertAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGifted and Talented EducationHigh SchoolHigher EducationHigher Education EdTechK-12Middle SchoolModern ParentingOnline Learning & eLearningParent & Family TechParentingPersonalized LearningPodcastPolicy & ReformSecondary EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 4: How to Create a Culturally Responsive Classroom

    Spread the loveBuilding a culturally responsive classroom is hard. To help you along your journey, here is your guide to exploring and respecting the cultural backgrounds of your students while ...

RSS Matthew on Education Week

  • Au Revoir from Education Futures November 20, 2018 Matthew Lynch
  • 6 Steps to Data-Driven Literacy Instruction October 17, 2018 Matthew Lynch
  • Four Keys to a Modern IT Approach in K-12 Schools October 2, 2018 Matthew Lynch
  • What's the Difference Between Burnout and Demoralization, and What Can Teachers Do About It? September 27, 2018 Matthew Lynch
  • Revisiting Using Edtech for Bullying and Suicide Prevention September 10, 2018 Matthew Lynch

About Us

The Edvocate was created in 2014 to argue for shifts in education policy and organization in order to enhance the quality of education and the opportunities for learning afforded to P-20 students in America. What we envisage may not be the most straightforward or the most conventional ideas. We call for a relatively radical and certainly quite comprehensive reorganization of America’s P-20 system.

That reorganization, though, and the underlying effort, will have much to do with reviving the American education system, and reviving a national love of learning.  The Edvocate plans to be one of key architects of this revival, as it continues to advocate for education reform, equity, and innovation.

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Contact

The Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
[email protected]

Follow us

Copyright (c) 2023 Matthew Lynch. All rights reserved.