The Edvocate

Top Menu

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • Books
    • Contact Us
    • Edupedia
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
    • Request a Product Review
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2020 Tech Edvocate Awards
    • Finalists and Winners of The 2019 Tech Edvocate Awards
    • Finalists and Winners of The 2018 Tech Edvocate Awards
    • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • The Edvocate Podcast

logo

The Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • Books
    • Contact Us
    • Edupedia
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
    • Request a Product Review
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2020 Tech Edvocate Awards
    • Finalists and Winners of The 2019 Tech Edvocate Awards
    • Finalists and Winners of The 2018 Tech Edvocate Awards
    • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • The Edvocate Podcast
  • How to Become an Education Administrator in Maryland

  • How to Implement Play-Based Learning into Your Classroom

  • How to Become an Education Administrator in Maine

  • How to Become an Education Administrator in Louisiana

  • How to Implement Flipped Instruction into Your Classroom

  • How to Become an Education Administrator in Kentucky

  • How to Become an Education Administrator in Kansas

  • Teaching & Learning Strategies, Concepts, and Terms That Every Teacher Must Know: Letters W-Z

  • How to Become an Education Administrator in Illinois

  • How to Become an Education Administrator in Iowa

Education NewsFirst Year TeachersParental InvolvementTeachersTesting
Home›Education News›Want to understand your child’s test scores? Here’s what to ignore

Want to understand your child’s test scores? Here’s what to ignore

By Matthew Lynch
October 15, 2016
Spread the love

Stephen Sireci, University of Massachusetts Amherst

Now that the first month of school is over, parents can get ready for the next milestone of the school year – they will soon get reports of the state tests their children took last year.

My estimates show that approximately 26 million students in public schools took statewide tests in reading and math last year. Many of them also took statewide tests in science. These tests provide important information to parents about how well their children are doing in school.

However, my research also shows that when parents receive their child’s test score report, they may have a tough time separating the important information from the statistical gibberish.

What’s more, the results might not even give them accurate information about their child’s academic growth.

Is your child ‘proficient’?

The No Child Left Behind law, enacted in 2002, required all states to set “achievement level standards” in reading and math for grades three through eight, and for one grade in high school, typically 10th or 11th grade. States were also required to develop tests to measure students’ level of “proficiency” on each test.

The new federal law passed in December 2015, the Every Student Succeeds Act (ESSA), will continue this practice.

As a result, the test reports parents receive classify children into achievement levels such as “basic” or “proficient.” Each state decides what these classifications are called, but at least one category must signify “proficient.”

These achievement level categories are described on the test score reports, and so this information is easily understood by parents. For example, I find it helpful each year to see if my sons reach proficiency in each subject area.

How is student growth being measured?
Student image via www.shutterstock.com

But children’s test scores in a given year, and their achievement level, are not the only information reported in some states. A new statistical index, called a “student growth percentile,” is finding its way into the reports sent home to parents in 11 states. Twenty-seven states use this index for evaluating teachers as well.

Although a measure of students’ “growth” or progress sounds like a good idea, student growth percentiles have yet to be supported by research. In fact several studies suggest they do not provide accurate descriptions of student progress and teacher effectiveness.

What does it mean?

What exactly are “student growth percentiles”?

They are indexes proposed in 2008 by Damian W. Betebenner, a statistician who suggested they be used as a descriptive measure of students’ “academic growth” from one school year to the next. The idea was to describe students’ progress in comparison to their peers.

Like the growth charts pediatricians use to describe children’s height and weight, student growth percentiles range from a low of one to a high of 99. However, their calculation involves a lot more error than physical measurement such as height and weight. Our research at the University of Massachusetts Amherst indicates substantial error in their calculation.

The scores do not actually measure children’s growth.
Children image via www.shutterstock.com

Student growth percentiles are derived from test scores, which are not perfectly accurate descriptions of students’ academic proficiency: Test scores are influenced by many factors, such as the questions asked on a particular day, students’ temperament, their level of engagement when taking the test or just the methods used to score their answers.

Each student’s growth percentile is calculated using at least two different test scores, typically a year or more apart. The most recent test scores of a student are then compared to the most recent test scores of students who had similar scores in previous years. This is to see which of those students had higher or lower scores this year.

The problem, however, is that each of the calculations carries some measurement error. Further calculations only compound that error. So much so that the results end up with twice as much error. No statistical sophistication can erase this error.

The question is, why are so many states using such an unreliable measure?

Using it for accountability

The use of student growth percentiles is due in part to a desire to see how much students learn in a particular year, and to link that progress to accountability systems such as teacher evaluation.

In 2010, the Race-to-the-Top grant competition invited states to come up with innovative ways of using test scores to evaluate teachers, which paved the way for this new measure of “growth” to be quickly applied across many states.

However, the use of student growth percentiles began before research was conducted on their accuracy. Only now is there a sufficient body of research to evaluate them, and all studies point to the same conclusion – they contain a lot of error.

In addition to our research at the University of Massachusetts Amherst, research on the accuracy of student growth percentiles has been conducted by education nonprofits such as WestEd, Educational Testing Service and other research institutions. Researchers J.R. Lockwood and Katherine E. Castellano recently concluded that “A substantial research base already notes that student growth percentile estimates for individual students have large errors.”

However, many states seem to be unaware of these research findings. Massachusetts even goes so far as to classify children with growth percentiles less than 40 as “lower growth” and children with growth percentiles greater than 60 as “higher growth.”

Measuring teacher performance

As I mentioned earlier, 27 states are using student growth percentiles to classify teachers as “effective” or “ineffective.” Research on the use of growth percentiles for this purpose indicates they could underestimate the performance of the most effective teachers, and overestimate the performance of the least effective teachers – the exact opposite of what these states are trying to do with their teacher evaluation systems.

These measures are being used for teacher performance as well.
Teacher image via www.shutterstock.com

A recent report by WestEd evaluated the use of student growth percentiles for evaluating teachers and concluded they “did not meet a level of stability” that would be needed for such high-stakes decisions.

Let’s go back to traditional measures

I believe student growth percentiles have taken us a step backwards in the use of educational tests to improve student learning.

Traditional measures of children’s performance on educational tests, such as whether they are “proficient” in a given year and their actual test scores, give a good idea of how well they performed in math or reading in a particular year.

These traditional percentile ranks are still reported on many educational tests, just like they were when we as parents were in school. Traditional percentile ranks compared us to a national or state group in a given year, rather than comparing us to how other kids in the nation or state were “growing” across different tests they took in different years, as student growth percentiles attempt to do.

Given what we now know about student growth percentiles, my advice to parents is not only to ignore them on their children’s test score reports, but also to contact their state department of education and ask why they are reporting such an unreliable statistic.

Developing measures of how much students have learned over the course of a year is a good goal. Unfortunately, student growth percentiles do not do a good job of measuring that.

The Conversation

Stephen Sireci, Professor of Educational Policy, University of Massachusetts Amherst

This article was originally published on The Conversation. Read the original article.


Spread the love
TagsedchatEducationeduchatk12ntchat
Previous Article

Schools gravitating toward healthy fundraising

Next Article

Where does anti-LGBT bias come from – ...

Matthew Lynch

Related articles More from author

  • Teachers

    Teachers, Don’t Miss These 5 Things When Writing an Individualized Education Program

    May 21, 2016
    By Matthew Lynch
  • Policy & ReformTeachers

    Check out the 5 Steps One School Takes to Transform Dropouts into Graduates

    July 3, 2016
    By Matthew Lynch
  • Policy & ReformTrending Topics

    Is charter school fraud the next Enron?

    June 2, 2017
    By Matthew Lynch
  • EdTech Startups & Businesses

    How Edtech Companies Can Breeze through the School Adoption Process

    March 23, 2018
    By Matthew Lynch
  • Education LeadershipPolicy & Reform

    How companies learn what children secretly want

    January 17, 2017
    By Matthew Lynch
  • Higher EducationHigher Education EdTech

    What Does A Future Ready University Look Like?

    April 18, 2018
    By Matthew Lynch

Leave a reply Cancel reply

  • Artificial Intelligence

    26 Ways That Artificial Intelligence (AI) is Transforming Education for the Better

  • Artificial Intelligence

    Schools Are Using AI to Track What Students Write On Their Computers

  • Artificial Intelligence

    What will AI Mean for Higher Education?

Search

Registration and Login

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Subscribe to The Edvocate Podcast

Apple PodcastsGoogle PodcastsAndroidby EmailRSS
  • Recent

  • Popular

  • Comments

  • How to Become an Education Administrator in Maryland

    By Matthew Lynch
    January 18, 2021
  • How to Implement Play-Based Learning into Your Classroom

    By Matthew Lynch
    January 18, 2021
  • How to Become an Education Administrator in Maine

    By Matthew Lynch
    January 17, 2021
  • How to Become an Education Administrator in Louisiana

    By Matthew Lynch
    January 16, 2021
  • How to Implement Flipped Instruction into Your Classroom

    By Matthew Lynch
    January 15, 2021
  • 18 Reasons the U.S. Education System is Failing

    By Matthew Lynch
    April 3, 2017
  • The Top 5 Unexpected Benefits of Early Childhood Education

    By Matthew Lynch
    February 29, 2016
  • 7 Benefits of STEM Education

    By Matthew Lynch
    January 12, 2019
  • The Dark Side of Educational Technology

    By Matthew Lynch
    October 15, 2016
  • Transformational vs. Contemporary Leadership Styles

    By Matthew Lynch
    February 28, 2016
  • Campuses Have Used IoT Projects to Promote Convenience, Security, and Comfort for Students - The Tech ...
    on
    January 15, 2021

    What Universities Have the Highest Rates of Sexual Assaults Per Capita

    […] security remains a ...
  • Europeans Reveal What 72 Things Weirded Them Out While Visiting America In This Viral Thread
    on
    January 12, 2021

    18 Reasons the U.S. Education System is Failing

    […] www.theedadvocate.org ...
  • Implementing Digital Literacy in the Classroom – MarkerSpace America
    on
    January 11, 2021

    8 Essential Digital Literacy Skills That Students Need

    […] of resources, tools, ...
  • Teaching Your Child to Read – Pedagogue
    on
    January 11, 2021

    Reading Tips for Reluctant Students

    […] do they do ...
  • Is Accreditation Necessary For Private Schools? – Pedagogue
    on
    January 11, 2021

    Should You Teach at a Public or Private School?

    […] there are many ...

Ask an Expert

  • Ask An Expert

    How Dumbed Down Education Is Creating a National Security Crisis

    Spread the loveFor the past few decades, our country’s educational system has seen both struggle and tremendous change. With the various ailments plaguing our educational system, education reforms have attempted ...
  • Ask An Expert

    21 Inspirational Quotes That Nelson Mandela Made About Education

    Spread the loveWe all have our heroes. Those human beings that seem larger than life and almost achieve Godlike status. One of my heroes is the late-great Nelson Mandela, who ...
  • Ask An ExpertAssistive TechnologyCareer ReadinessChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEducation LeadershipElementary EducationElementary SchoolEquityFirst Year TeachersFreshHigh SchoolK-12Middle SchoolModern ParentingParent & Family TechParental InvolvementParentingPersonalized LearningPodcastPolicy & ReformPreK-12Special EducationSTEMTeacher EducationTeachers

    The Edvocate Podcast, Episode 7: How Digital Age Teachers Can Win Over Parents

    Spread the loveEducation is a collaborative process, as it takes many stakeholders working in unison to help students succeed academically. One of the most integral parts of this collaborative team ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...

International Education

  • International Education

    How Can We Improve Teacher Training in the World’s Poorest Countries?

    Spread the loveAccess to education is a basic human right and a subject of importance in every part of the world. The desire and dedication to go to school are ...
  • International Education

    How COVID-19 is Creating a Global Education Crisis

    Spread the loveWhile the novel coronavirus has brought the entire world to a standstill, it’s the education sector that will suffer the most consequences. Almost all across the globe, the ...
  • International Education

    Which Countries Provide Free Education At A University Level?

    Spread the loveAlmost two dozen countries provide free or nearly-free university-level education to their citizens. Some even allow students from other countries to participate in their free education programs; some ...
  • International Education

    Teachers’ Pay Must Be at the Heart of Global Education Reform

    Spread the loveWhile most in the education field believe they are underpaid for the work they do, there are many people who argue that teachers’ pay is fair. Some of ...
  • International Education

    Innovative Approaches to Global Education Challenges

    Spread the loveGlobal education is an ideology that deals with the enhancement of individual perception of the whole world. It is an approach that helps us to become global citizens. ...

Early Childhood Education

  • Child DevelopmentEarly ChildhoodParenting

    40 Questions to Ask When Choosing Your Child’s Preschool

    Spread the loveIn six months or so, we plan to move my 4-year old son Matthias to a new preschool. We are looking for a location that is close to ...
  • Child DevelopmentEarly ChildhoodModern ParentingParenting

    Should You Choose a Play-Based or Academic Based Preschool For Your Children?

    Spread the loveAs parents await their child’s first school years, it is unclear what they should expect when they finally send their three- to five-year-old children to a preschool. Many ...
  • Early ChildhoodEquity

    The Foundational Principles of Anti-Racist Early Childhood Education

    Spread the loveFor children to have an anti-racist early childhood education, many steps must be taken by parents and educators. Some of these steps occur before children even set foot ...
  • Early Childhood

    Growing And Guiding Early Childhood Education Leadership

    Spread the loveEducational leadership is vital in any school whether it is elementary, middle, or high school. Depending on the school’s age range it is important for the leadership (which ...
  • Early Childhood

    Reducing The Role Of Implicit Bias In Early Childhood Education Settings

    Spread the loveImplicit bias is defined as the attitudes or stereotypes that affect our understanding, actions, and decisions in an unconscious manner. While bias is inescapable, that does not mean ...

Gifted and Talented Education

  • Gifted and Talented Education

    The Edvocate’s Guide to Working With Twice-Exceptional Students

    Spread the loveTwice-exceptional is a term used to explain kids who have exceptional talents in some educational areas and challenges in others. In some instances, a twice-exceptional learner could theoretically ...
  • Gifted and Talented Education

    Implementing Curriculum Compacting in Your Classroom

    Spread the loveAll educators agree that differentiating instruction for students is very important. Yet, many districts cannot put this policy into practice. An almost unlimited amount of remedial curricular content ...
  • Gifted and Talented Education

    What Does Academic Enrichment Involve?

    Spread the loveAcademic enrichment activities in the class can take numerous forms and do not always involve prescribed lessons from the curriculum. Enrichment encourages learners to take a more expansive ...
  • Gifted and Talented Education

    What is Academic Enrichment?

    Spread the loveSome learners struggle to keep up in class. Other learners have the opposite challenge. For some learners, their learning moves through content too slowly, causing a lack of ...
  • Gifted and Talented Education

    The Edvocate’s Guide to Cluster Grouping

    Spread the loveCluster grouping is a method educators utilize to meet gifted kids’ educational needs. If cluster grouping isn’t practiced at a certain grade level or a certain school, contemplate ...

Black Boys in Crisis Series

  • Black Boys in Crisis

    The Importance of Mentoring Young African-American Males

    Spread the loveTeachers need to realize that at home, in their neighborhoods, and in school, many students face difficulties that can interfere with learning. Compared to their middle-class counterparts, it ...
  • Black Boys in CrisisDiversityEquity

    7 Ways That Black Students are Discriminated Against in U.S K-12 Schools

    Spread the loveAfrican Africans have a long history of being mistreated in the United States, starting with slavery. It should come as no surprise that their children face the same ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...
  • Ask An ExpertAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGifted and Talented EducationHigh SchoolHigher EducationHigher Education EdTechK-12Middle SchoolModern ParentingOnline Learning & eLearningParent & Family TechParentingPersonalized LearningPodcastPolicy & ReformSecondary EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 4: How to Create a Culturally Responsive Classroom

    Spread the loveBuilding a culturally responsive classroom is hard. To help you along your journey, here is your guide to exploring and respecting the cultural backgrounds of your students while ...

RSS Matthew on Education Week

  • Au Revoir from Education Futures November 20, 2018 Matthew Lynch
  • 6 Steps to Data-Driven Literacy Instruction October 17, 2018 Matthew Lynch
  • Four Keys to a Modern IT Approach in K-12 Schools October 2, 2018 Matthew Lynch
  • What's the Difference Between Burnout and Demoralization, and What Can Teachers Do About It? September 27, 2018 Matthew Lynch
  • Revisiting Using Edtech for Bullying and Suicide Prevention September 10, 2018 Matthew Lynch

About Us

The Edvocate was created in 2014 to argue for shifts in education policy and organization in order to enhance the quality of education and the opportunities for learning afforded to P-20 students in America. What we envisage may not be the most straightforward or the most conventional ideas. We call for a relatively radical and certainly quite comprehensive reorganization of American’s P-20 system.

That reorganization, though, and the underlying effort, will have much to do with reviving the American education system, and reviving a national love of learning.  The Edvocate plans to be one of key architects of this revival, as it continues to advocate for education reform, equity, and innovation.

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Contact

The Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
advocatefored@gmail.com

Follow us

Copyright (c) 2021 Matthew Lynch. All rights reserved.