The Edvocate

Top Menu

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • P-20 Ed Careers

logo

The Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • P-20 Ed Careers
  • Study Strategies for Your Style of Learning

  • Why Your Classroom Needs Online Learning

  • How Much Should Your ELearning Cost?

  • Main Ideas: Everything You Need to Know

  • First Year Survival Tips for a School Principal

  • Here’s Why You Should Learn Mandarin Chinese

  • 3 Easy Steps to Collaboration Tech

  • How Educators Use Artificial Intelligence to Add Instructional Value

  • Tips for Selling to Districts, Schools, and Educators

  • Why Learning Analytics Are Key to Edtech Adoption

Education NewsFirst Year TeachersParental InvolvementTeachersTesting
Home›Education News›Want to understand your child’s test scores? Here’s what to ignore

Want to understand your child’s test scores? Here’s what to ignore

By Matthew Lynch
October 15, 2016
6342
0
Spread the love

Stephen Sireci, University of Massachusetts Amherst

Now that the first month of school is over, parents can get ready for the next milestone of the school year – they will soon get reports of the state tests their children took last year.

My estimates show that approximately 26 million students in public schools took statewide tests in reading and math last year. Many of them also took statewide tests in science. These tests provide important information to parents about how well their children are doing in school.

However, my research also shows that when parents receive their child’s test score report, they may have a tough time separating the important information from the statistical gibberish.

What’s more, the results might not even give them accurate information about their child’s academic growth.

Is your child ‘proficient’?

The No Child Left Behind law, enacted in 2002, required all states to set “achievement level standards” in reading and math for grades three through eight, and for one grade in high school, typically 10th or 11th grade. States were also required to develop tests to measure students’ level of “proficiency” on each test.

The new federal law passed in December 2015, the Every Student Succeeds Act (ESSA), will continue this practice.

As a result, the test reports parents receive classify children into achievement levels such as “basic” or “proficient.” Each state decides what these classifications are called, but at least one category must signify “proficient.”

These achievement level categories are described on the test score reports, and so this information is easily understood by parents. For example, I find it helpful each year to see if my sons reach proficiency in each subject area.

How is student growth being measured?
Student image via www.shutterstock.com

But children’s test scores in a given year, and their achievement level, are not the only information reported in some states. A new statistical index, called a “student growth percentile,” is finding its way into the reports sent home to parents in 11 states. Twenty-seven states use this index for evaluating teachers as well.

Although a measure of students’ “growth” or progress sounds like a good idea, student growth percentiles have yet to be supported by research. In fact several studies suggest they do not provide accurate descriptions of student progress and teacher effectiveness.

What does it mean?

What exactly are “student growth percentiles”?

They are indexes proposed in 2008 by Damian W. Betebenner, a statistician who suggested they be used as a descriptive measure of students’ “academic growth” from one school year to the next. The idea was to describe students’ progress in comparison to their peers.

Like the growth charts pediatricians use to describe children’s height and weight, student growth percentiles range from a low of one to a high of 99. However, their calculation involves a lot more error than physical measurement such as height and weight. Our research at the University of Massachusetts Amherst indicates substantial error in their calculation.

The scores do not actually measure children’s growth.
Children image via www.shutterstock.com

Student growth percentiles are derived from test scores, which are not perfectly accurate descriptions of students’ academic proficiency: Test scores are influenced by many factors, such as the questions asked on a particular day, students’ temperament, their level of engagement when taking the test or just the methods used to score their answers.

Each student’s growth percentile is calculated using at least two different test scores, typically a year or more apart. The most recent test scores of a student are then compared to the most recent test scores of students who had similar scores in previous years. This is to see which of those students had higher or lower scores this year.

The problem, however, is that each of the calculations carries some measurement error. Further calculations only compound that error. So much so that the results end up with twice as much error. No statistical sophistication can erase this error.

The question is, why are so many states using such an unreliable measure?

Using it for accountability

The use of student growth percentiles is due in part to a desire to see how much students learn in a particular year, and to link that progress to accountability systems such as teacher evaluation.

In 2010, the Race-to-the-Top grant competition invited states to come up with innovative ways of using test scores to evaluate teachers, which paved the way for this new measure of “growth” to be quickly applied across many states.

However, the use of student growth percentiles began before research was conducted on their accuracy. Only now is there a sufficient body of research to evaluate them, and all studies point to the same conclusion – they contain a lot of error.

In addition to our research at the University of Massachusetts Amherst, research on the accuracy of student growth percentiles has been conducted by education nonprofits such as WestEd, Educational Testing Service and other research institutions. Researchers J.R. Lockwood and Katherine E. Castellano recently concluded that “A substantial research base already notes that student growth percentile estimates for individual students have large errors.”

However, many states seem to be unaware of these research findings. Massachusetts even goes so far as to classify children with growth percentiles less than 40 as “lower growth” and children with growth percentiles greater than 60 as “higher growth.”

Measuring teacher performance

As I mentioned earlier, 27 states are using student growth percentiles to classify teachers as “effective” or “ineffective.” Research on the use of growth percentiles for this purpose indicates they could underestimate the performance of the most effective teachers, and overestimate the performance of the least effective teachers – the exact opposite of what these states are trying to do with their teacher evaluation systems.

These measures are being used for teacher performance as well.
Teacher image via www.shutterstock.com

A recent report by WestEd evaluated the use of student growth percentiles for evaluating teachers and concluded they “did not meet a level of stability” that would be needed for such high-stakes decisions.

Let’s go back to traditional measures

I believe student growth percentiles have taken us a step backwards in the use of educational tests to improve student learning.

Traditional measures of children’s performance on educational tests, such as whether they are “proficient” in a given year and their actual test scores, give a good idea of how well they performed in math or reading in a particular year.

These traditional percentile ranks are still reported on many educational tests, just like they were when we as parents were in school. Traditional percentile ranks compared us to a national or state group in a given year, rather than comparing us to how other kids in the nation or state were “growing” across different tests they took in different years, as student growth percentiles attempt to do.

Given what we now know about student growth percentiles, my advice to parents is not only to ignore them on their children’s test score reports, but also to contact their state department of education and ask why they are reporting such an unreliable statistic.

Developing measures of how much students have learned over the course of a year is a good goal. Unfortunately, student growth percentiles do not do a good job of measuring that.

The Conversation

Stephen Sireci, Professor of Educational Policy, University of Massachusetts Amherst

This article was originally published on The Conversation. Read the original article.

TagsedchatEducationeduchatk12ntchat
Previous Article

Schools gravitating toward healthy fundraising

Next Article

Where does anti-LGBT bias come from – ...

Matthew Lynch

Related articles More from author

  • EdTech & Innovation

    Why science and engineering need to remind students of forgotten lessons from history

    December 27, 2016
    By Matthew Lynch
  • Black Boys in CrisisEquityTrending Topics

    Black Boys in Crisis: Why Care About the School-to-Prison Pipeline?

    October 8, 2017
    By Matthew Lynch
  • Matthew LynchTeachersTesting

    Educators: Ensure Your Corrective Feedback Is Top-Notch

    August 23, 2016
    By Matthew Lynch
  • EquityMatthew Lynch

    Should Bi-Lingual Learning be Required?

    February 28, 2015
    By Matthew Lynch
  • Teachers

    Do American sex education classes make the grade?

    December 17, 2015
    By Matthew Lynch
  • Black Boys in CrisisEquityTrending Topics

    Black Boys in Crisis: Lessons from the Central Park Five Tragedy

    September 2, 2017
    By Matthew Lynch

Leave a reply Cancel reply

  • Artificial IntelligenceEdTech & Innovation

    Customized Educational Programs Through AI

  • Artificial IntelligenceEarly Childhood & K-12 EdTech

    The Effects of Artificial Intelligence on Education

  • Artificial Intelligence

    Exploration Into the Roots of Artificial Intelligence in Education

Search

Registration and Login

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Subscribe to The Edvocate Podcast

Apple PodcastsGoogle PodcastsAndroidby EmailRSS
  • Recent

  • Popular

  • Comments

  • Study Strategies for Your Style of Learning

    By Matthew Lynch
    May 20, 2022
  • Why Your Classroom Needs Online Learning

    By Matthew Lynch
    May 19, 2022
  • How Much Should Your ELearning Cost?

    By Matthew Lynch
    May 19, 2022
  • Main Ideas: Everything You Need to Know

    By Matthew Lynch
    May 19, 2022
  • First Year Survival Tips for a School Principal

    By Matthew Lynch
    May 19, 2022
  • 18 Reasons the U.S. Education System is Failing

    By Matthew Lynch
    April 3, 2017
  • The Top 5 Unexpected Benefits of Early Childhood Education

    By Matthew Lynch
    February 29, 2016
  • 7 Benefits of STEM Education

    By Matthew Lynch
    January 12, 2019
  • What is Culturally Responsive Pedagogy?

    By Matthew Lynch
    April 21, 2016
  • pass or fail

    Black Boys in Crisis: Why Aren’t They Reading?

    By Matthew Lynch
    January 16, 2017
  • Is My Student's High School Rigorous Enough? - Helping Your College Student Succeed
    on
    May 18, 2022

    Academic rigor: you’re doing it wrong and here’s why

    […] are or the ...
  • STEM Education - My Blog
    on
    May 16, 2022

    7 Benefits of STEM Education

    […] conclusion, STEM education ...
  • 100 Ideas for Your Research Paper Topics of 2019 | New Life Christian Center
    on
    May 16, 2022

    5 Ways Creative Writing Makes Students Productive and Motivated

    […] view.The ultimate goal ...
  • Stefanie B.C
    on
    May 12, 2022

    Pass or Fail: Standardized Testing and Education Problems in the U.S.

    I am the mother ...
  • 4 Strategies AI Will Be a Terrific Teaching Assistant – Ssc Wanfa
    on
    May 10, 2022

    Seven Things Assessment-Literate Educators Need to Do When Creating Quality Assessments

    […] is a further ...

Ask an Expert

  • Ask An Expert

    How Dumbed Down Education Is Creating a National Security Crisis

    Spread the loveFor the past few decades, our country’s educational system has seen both struggle and tremendous change. With the various ailments plaguing our educational system, education reforms have attempted ...
  • Ask An Expert

    21 Inspirational Quotes That Nelson Mandela Made About Education

    Spread the loveWe all have our heroes. Those human beings that seem larger than life and almost achieve Godlike status. One of my heroes is the late-great Nelson Mandela, who ...
  • Ask An ExpertAssistive TechnologyCareer ReadinessChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEducation LeadershipElementary EducationElementary SchoolEquityFirst Year TeachersFreshHigh SchoolK-12Middle SchoolModern ParentingParent & Family TechParental InvolvementParentingPersonalized LearningPodcastPolicy & ReformPreK-12Special EducationSTEMTeacher EducationTeachers

    The Edvocate Podcast, Episode 7: How Digital Age Teachers Can Win Over Parents

    Spread the loveEducation is a collaborative process, as it takes many stakeholders working in unison to help students succeed academically. One of the most integral parts of this collaborative team ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...

International Education

  • International Education

    How International Baccalaureate (IB) Programs Work

    Spread the loveThe International Baccalaureate Program is a very intensive pre-college program in which when students get involved, they get college credit. Unlike most other learning initiatives, this program deeply ...
  • International Education

    Globalization: Everything You Need to Know

    Spread the loveGlobalization is the growing interconnectedness of countries around the world. It involves increasing communication and various forms of interaction between people of different nations, ethnicities and cultures. There ...
  • AssessmentEducation LeadershipHigher EducationInternational EducationProfessional DevelopmentTeachers

    So You Want to Attend Graduate School: The 411 on Grad School Admissions Tests

    Spread the loveApplying for admission to professional and graduate schools is no less competitive than college/undergraduate admissions. If you’re planning to pursue a degree in business, law, medicine, or graduate ...
  • Higher EducationInternational Education

    What Extracurricular Activities Impress Colleges the Most?

    Spread the loveWhen you apply to schools that offer holistic admissions or apply to a college using the Common Application, you will have to describe your participation in extracurricular activities. ...
  • Higher EducationInternational Education

    Tips for Working on a College Group Project

    Spread the loveIt can be a great experience to work together and do a group project in college. But it can also be a nightmare if there is no cooperation ...

Early Childhood Education

  • Early ChildhoodLanguage Education

    Long Vowels: Everything You Need to Know

    Spread the loveLong vowels are special vowel types that sound exactly like the letters which comprise them. Long vowels are typically taught after short vowels because while it seems less ...
  • Early Childhood

    What is a Digraph (vowel)?

    Spread the loveA vowel digraph refers to the distinctive perception of one sound when two vowels are placed together in one word. e.g., ow, oa, ie, ea. For learners, vowel ...
  • Early Childhood

    What is a Digraph (consonant)?

    Spread the loveA consonant digraph refers to the distinctive perception of one sound when two consonant letters are placed together in one word, e.g., ch, ng, sh, ph. It’s important ...
  • Early Childhood

    Modifications: Everything You Need to Know

    Spread the loveThis term refers to the adjustments made to what a child is required to learn in school. Some common examples of modifications include reworded questions in easier language, ...
  • Early Childhood

    Wraparound Services/Programs: Everything You Need to Know

    Spread the loveThese are programs that have social measures available for children who are at risk.  Hypothetically, these services are engineered toward developing a strong sense of self and the ...

Gifted and Talented Education

  • Gifted and Talented Education

    Twice-Exceptional: What Does it Mean?

    Spread the loveTo be twice-exceptional is to be exceptionally gifted in some academic aspects while being below average compared to peers in other aspects. As a matter of fact, such ...
  • Gifted and Talented Education

    A Guide to Talent Search Programs

    Spread the loveThe Talent Search Initiative has as its aim; the identification of high-performing students by organizing specific tests. Different avenues are then provided for these students to channel their ...
  • Gifted and Talented EducationK-12

    Homogeneous Grouping: What You Need to Know

    Spread the loveThis term refers to the grouping of students by mental capability, aptitude, or hobbies. For instance, gifted students are placed in one group, and students with special needs ...
  • Gifted and Talented Education

    Cluster Grouping: What You Need to Know

    Spread the loveThis term describes a manner of classifying gifted students to place them in properly segmented classrooms. For example, about five to seven extremely bright pupils with comparable skill ...
  • Gifted and Talented EducationHigher Education

    Merit Scholarships: Everything Your Need to Know

    Spread the loveThese are monetary gifts awarded by institutions to superbly gifted students, who have set themselves apart by their exceptional performance in schoolwork, regardless of whether they require the ...

Black Boys in Crisis Series

  • Black Boys in Crisis

    The Importance of Mentoring Young African-American Males

    Spread the loveTeachers need to realize that at home, in their neighborhoods, and in school, many students face difficulties that can interfere with learning. Compared to their middle-class counterparts, it ...
  • Black Boys in CrisisDiversityEquity

    7 Ways That Black Students are Discriminated Against in U.S K-12 Schools

    Spread the loveAfrican Africans have a long history of being mistreated in the United States, starting with slavery. It should come as no surprise that their children face the same ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...
  • Ask An ExpertAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGifted and Talented EducationHigh SchoolHigher EducationHigher Education EdTechK-12Middle SchoolModern ParentingOnline Learning & eLearningParent & Family TechParentingPersonalized LearningPodcastPolicy & ReformSecondary EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 4: How to Create a Culturally Responsive Classroom

    Spread the loveBuilding a culturally responsive classroom is hard. To help you along your journey, here is your guide to exploring and respecting the cultural backgrounds of your students while ...

RSS Matthew on Education Week

  • Au Revoir from Education Futures November 20, 2018 Matthew Lynch
  • 6 Steps to Data-Driven Literacy Instruction October 17, 2018 Matthew Lynch
  • Four Keys to a Modern IT Approach in K-12 Schools October 2, 2018 Matthew Lynch
  • What's the Difference Between Burnout and Demoralization, and What Can Teachers Do About It? September 27, 2018 Matthew Lynch
  • Revisiting Using Edtech for Bullying and Suicide Prevention September 10, 2018 Matthew Lynch

About Us

The Edvocate was created in 2014 to argue for shifts in education policy and organization in order to enhance the quality of education and the opportunities for learning afforded to P-20 students in America. What we envisage may not be the most straightforward or the most conventional ideas. We call for a relatively radical and certainly quite comprehensive reorganization of America’s P-20 system.

That reorganization, though, and the underlying effort, will have much to do with reviving the American education system, and reviving a national love of learning.  The Edvocate plans to be one of key architects of this revival, as it continues to advocate for education reform, equity, and innovation.

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Contact

The Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
[email protected]

Follow us

Copyright (c) 2022 Matthew Lynch. All rights reserved.