The Edvocate

Top Menu

Main Menu

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • P-20 Ed Careers

logo

The Edvocate

  • Start Here
    • Our Brands
    • Governance
      • Lynch Educational Consulting
      • Dr. Lynch’s Personal Website
        • My Speaking Page
      • Careers
    • Write For Us
    • Books
    • The Tech Edvocate Product Guide
    • Contact Us
    • The Edvocate Podcast
    • Edupedia
    • Terms and Conditions
    • Privacy Policy
  • PreK-12
    • Assessment
    • Assistive Technology
    • Child Development
    • Classroom Management
    • Early Childhood
    • EdTech & Innovation
    • Education Leadership
    • Equity
    • First Year Teachers
    • Gifted and Talented Education
    • Parental Involvement
    • Policy & Reform
    • Special Education
    • Teachers
  • Higher Ed
    • Best Colleges and Universities
    • Best College and University Programs
    • Diversity
    • HBCU’s
    • Higher Education
    • Higher Education EdTech
    • International Education
  • Advertise
  • The Tech Edvocate Awards
    • The Awards Process
    • Finalists and Winners of The 2022 Tech Edvocate Awards
      • Finalists and Winners of The 2021 Tech Edvocate Awards
      • Finalists and Winners of The 2020 Tech Edvocate Awards
      • Finalists and Winners of The 2019 Tech Edvocate Awards
      • Finalists and Winners of The 2018 Tech Edvocate Awards
      • Finalists and Winners of The 2017 Tech Edvocate Awards
    • Award Seals
  • Apps
    • GPA Calculator for College
    • GPA Calculator for High School
    • Cumulative GPA Calculator
    • Grade Calculator
    • Weighted Grade Calculator
    • Final Grade Calculator
  • The Tech Edvocate
  • Pedagogue
  • P-20 Ed Careers
  • How to Use Virtual Reality in Nursing

  • How to Secure Distance Learning Info in the Hacking Prone Environment

  • Glossary of Grammar Terms

  • How to Empower Your Faculty in an M-learning Environment

  • Tips for Teaching Learners Remotely

  • Math Terms That Everyone Should Know

  • Neglectful Parenting Style: Everything You Need to Know

  • Graduate School: Everything You Need to Know

  • Nailing the Perfect Email – How to Professionally Correspond with your Professor

  • Many Important Questions That Tech Coaches Have to Ask Each Other

Policy & ReformTrending Topics
Home›Policy & Reform›Pass or Fail: Is Testing a Valid Way to Measure Student Progress?

Pass or Fail: Is Testing a Valid Way to Measure Student Progress?

By Matthew Lynch
July 10, 2017
9309
0
pass or fail
Spread the love

In this multi-part series, I provide a dissection of the phenomenon of retention and social promotion. Also, I describe the many different methods that would improve student instruction in classrooms and eliminate the need for retention and social promotion if combined effectively.

While reading this series, periodically ask yourself this question: Why are educators, parents and the American public complicit in a practice that does demonstrable harm to children and the competitive future of the country?

What if the measures we use to determine passing or failing grades are completely skewed? Is standardized testing, or any testing for that matter, the right way to determine student progress?

For obvious reasons, one of the first and most significant concerns for the application of standardized tests is that they are not consistent with the standards for fair and appropriate testing. Of course, educators must first define the standards themselves, and demonstrate them to be relevant. In this instance, we are referring to the standards for fair and appropriate testing as defined by the NRC Report, which says that measurement validity refers to the extent to which evidence supports a proposed interpretation and use of test scores for a particular purpose.

For instance, a measurement validity of the reading section of the SAT I standard test would be assessed to have a reasonable validity for assessment of an individual’s reading comprehension skills, knowledge of grammar rules, and ability to make inferences from texts. The use of scores from this test to determine an individual’s preparedness for entry into a particular college program would also be reasonably good. The component of appropriate testing usually overlaps with this second issue of validity, too, which the NRC Report Standards also outlines, and which is backed up by the findings of various other organizations.

To go back to the more formal parameters, the general rule is that the internal structure of the test, the content of the test, the relationship of the test to other criteria, and the psychological processes and cognitive operations used by the examinee in responding to the test items must all support the purpose of the test.

A test assessing knowledge and skill should target the knowledge and skills specifically; looking, as well, to ensure that the knowledge and skills being assessed are those that have been obtained from appropriate instruction. In some instances, knowledge might depend on poor instruction or on factors that are unrelated to the skills under review. For instance, a student might score poorly on the SAT reading test because their teachers didn’t transfer the necessary knowledge and skill (the students may not have received the targeted knowledge of proper grammar, for instance, or they have received inadequate instruction on how to read critically).

Another example would be that an individual might score badly on the SAT reading test not because they lack reading comprehension skills that the test intends to assess but because they have significant language barriers or because there are cultural differences that have some bearing on the test. For instance, a passage in American history that is being read for comprehension but that in some way relies upon presupposed knowledge of American history or customs might be problematic and undermine the validity and fairness of tests scores, undermining the attribution of cause.

Disabilities can also factor as an issue for the attribution of cause. Several types of cognitive or even physical disabilities can undermine an individual’s performance in a testing scenario without appropriate interventions provided to support the student’s exceptionalities.

In the context of K-12 assessments, the cause component also influences the extent to which students receive adequate opportunity to learn the material for the test. Adequate quality and quantity of instruction become important, as does the alignment of test content and curriculum.

Students need adequate opportunity within the testing scenarios to demonstrate their knowledge. If tests contain irrelevant language or content, for instance, students may not have adequate opportunity to perform and test developers will have compromised the fairness and relevance of the test.

Furthermore, many of the criteria for fairness in testing standards overlap with attribution of cause. In the Standards, overlapping elements include the investigation of bias and differential item functioning, determining whether construct-irrelevant variance differentially affects different groups of examinees, and equal treatment during the testing process.

Circular validity lies within the cause component in the sense that it relates to the alignment between test content and the curriculum taught in class. Chapter 13 of the Standards determines that “There should be evidence that the test adequately covers only the specific or generalized content and skills that students have had an opportunity to learn.”

This goes beyond the criteria outlined here and applies to a broader interpretation of opportunity to learn; one that is not restricted to curricular validity but also inclusive of the consideration of instructional quality as a predictor of student test scores.

Certain polices within the K-12 setting make high-stakes student decisions dependent upon evidence that the student has the educational experience and opportunity to acquire relevant knowledge and skill. Where students have lacked sufficient opportunity to acquire desired skills in an educational context, they may not meet the criteria for grade promotion or graduation.

At the same time, though, it is hardly fair that the student be held accountable for the deficit in their learning. At what point do we say: this portion of education is the responsibility of the schools, of the system and the stakeholders, not just the individual student?

The effectiveness of treatment is the final component of the fair and appropriate test criteria, relating to whether test scores lead to consequences that are educationally beneficial in a given context. Consequences could include placement in a particular academic grouping based on ability or advancement from one level of learning to a higher level based on test achievement. Accountability plays a part here, too, as the criteria for effective treatment determines that it is inappropriate to use tests to make placements that are not educationally beneficial.

When tests are used in placement decisions, they must be fair and appropriate. Students must be “better off in the setting in which they are placed than they would be in a different available setting.” With all of these factors in mind, though, can testing ever truly be trusted as a placement option for students?

TagsassessmentsEducationK-12retentionretention and social promotion seriessocial promotion
Previous Article

The A-Z of Education: Curriculum and Instruction

Next Article

MeTEOR Education’s High-Impact Learning Environments Increase Cooperative ...

Matthew Lynch

Related articles More from author

  • Teachers

    Determining Your Educational Philosophy Part IV: Philosophy of Essential Skills & Information

    August 5, 2016
    By Matthew Lynch
  • Retention & Social Promotion SeriesTrending Topics

    Pass or Fail: Does our Education System Set Kids Up to Fail?

    August 30, 2017
    By Matthew Lynch
  • Uncategorized

    The Edvocate’s List of the 20 Best Education Systems in the World

    January 20, 2017
    By Matthew Lynch
  • Education LeadershipTeachers

    Kindergartners get little time to play. Why does it matter?

    January 7, 2017
    By Matthew Lynch
  • Education LeadershipTeachers

    What is the Importance of a Personal Learning Network?

    August 3, 2017
    By Matthew Lynch
  • EdTech & Innovation

    Using twitter in the classroom – from the perspective of students

    September 20, 2016
    By Matthew Lynch

Leave a reply Cancel reply

  • Artificial Intelligence

    In a World of Artificial Intelligence, Where Does Emotional Intelligence Fit In?

  • Artificial IntelligencePersonalized Learning

    AI Scales Personalized Education in Ways the Teacher Can’t

  • Artificial Intelligence

    AI Has Started a Revolution in Education

Search

Registration and Login

  • Register
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Subscribe to The Edvocate Podcast

Apple PodcastsGoogle PodcastsAndroidby EmailRSS
  • Recent

  • Popular

  • Comments

  • How to Use Virtual Reality in Nursing

    By Matthew Lynch
    July 2, 2022
  • How to Secure Distance Learning Info in the Hacking Prone Environment

    By Matthew Lynch
    July 2, 2022
  • Glossary of Grammar Terms

    By Matthew Lynch
    July 2, 2022
  • How to Empower Your Faculty in an M-learning Environment

    By Matthew Lynch
    July 1, 2022
  • Tips for Teaching Learners Remotely

    By Matthew Lynch
    July 1, 2022
  • 18 Reasons the U.S. Education System is Failing

    By Matthew Lynch
    April 3, 2017
  • The Top 5 Unexpected Benefits of Early Childhood Education

    By Matthew Lynch
    February 29, 2016
  • 7 Benefits of STEM Education

    By Matthew Lynch
    January 12, 2019
  • What is Culturally Responsive Pedagogy?

    By Matthew Lynch
    April 21, 2016
  • pass or fail

    Black Boys in Crisis: Why Aren’t They Reading?

    By Matthew Lynch
    January 16, 2017
  • Business model canvas for elementary school - Model canvas
    on
    July 2, 2022

    Ask An Expert: School Systems and Business Models

    […] https://www.theedadvocate.org/ask-an-expert-school-systems-and-business-models/ […]
  • Pastor W. Eric Croomes
    on
    July 2, 2022

    Black Boys in Crisis: Why Aren’t They Reading?

    I agree. So many ...
  • Reading Fluency – Educators For You
    on
    June 30, 2022

    Reading Fluency Building Apps, Tools, and Resources That We Love

    […] Try these fluency ...
  • The Top Streaming Trends for 2022 - BingedNow
    on
    June 30, 2022

    Advantages Of Streaming In Schools

    […] also gives educators ...
  • The Top Streaming Trends for 2022 - Telegraph Star
    on
    June 29, 2022

    Advantages Of Streaming In Schools

    […] also gives educators ...

Ask an Expert

  • Ask An Expert

    How Dumbed Down Education Is Creating a National Security Crisis

    Spread the loveFor the past few decades, our country’s educational system has seen both struggle and tremendous change. With the various ailments plaguing our educational system, education reforms have attempted ...
  • Ask An Expert

    21 Inspirational Quotes That Nelson Mandela Made About Education

    Spread the loveWe all have our heroes. Those human beings that seem larger than life and almost achieve Godlike status. One of my heroes is the late-great Nelson Mandela, who ...
  • Ask An ExpertAssistive TechnologyCareer ReadinessChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEducation LeadershipElementary EducationElementary SchoolEquityFirst Year TeachersFreshHigh SchoolK-12Middle SchoolModern ParentingParent & Family TechParental InvolvementParentingPersonalized LearningPodcastPolicy & ReformPreK-12Special EducationSTEMTeacher EducationTeachers

    The Edvocate Podcast, Episode 7: How Digital Age Teachers Can Win Over Parents

    Spread the loveEducation is a collaborative process, as it takes many stakeholders working in unison to help students succeed academically. One of the most integral parts of this collaborative team ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...

International Education

  • Education FoundationsInternational Education

    4 Reasons You Should Study Geography

    Spread the loveUsually, people are under the wrong impression that geography does not offer many job opportunities, and there are no jobs for a geographer. They think that studying geography ...
  • International Education

    How International Baccalaureate (IB) Programs Work

    Spread the loveThe International Baccalaureate Program is a very intensive pre-college program in which when students get involved, they get college credit. Unlike most other learning initiatives, this program deeply ...
  • International Education

    Globalization: Everything You Need to Know

    Spread the loveGlobalization is the growing interconnectedness of countries around the world. It involves increasing communication and various forms of interaction between people of different nations, ethnicities and cultures. There ...
  • AssessmentEducation LeadershipHigher EducationInternational EducationProfessional DevelopmentTeachers

    So You Want to Attend Graduate School: The 411 on Grad School Admissions Tests

    Spread the loveApplying for admission to professional and graduate schools is no less competitive than college/undergraduate admissions. If you’re planning to pursue a degree in business, law, medicine, or graduate ...
  • Higher EducationInternational Education

    What Extracurricular Activities Impress Colleges the Most?

    Spread the loveWhen you apply to schools that offer holistic admissions or apply to a college using the Common Application, you will have to describe your participation in extracurricular activities. ...

Early Childhood Education

  • Early Childhood

    18 Alphabet Videos to Help Kids Learn Their A.B.C.s

    Spread the loveIs anything more important in a young student’s life than learning their A.B.C.s? These alphabet videos help reinforce the letters and their sounds in a fun and engaging ...
  • Early Childhood

    16 Clean Up Songs for Kids

    Spread the loveCleaning up is a real drag, so We’ve put together this list of catchy clean-up songs for kids! Clean Up the Room https://youtu.be/GfTT8WBL3nM  Clean Up Song for Children ...
  • Early Childhood

    15 Fun Phonics Songs for Kids

    Spread the loveIn need of fun phonics songs for your students. Check out ou list? Alphabet Song https://youtu.be/R2frjzrC5Jg  The A.B.C. Song for Kids https://youtu.be/nKYCy4ZNBpU  Alphabet PE Exercise Song https://youtu.be/O6DgdjvbIyQ  CVC ...
  • Early Childhood

    25 Second Grade Jokes to Begin The Day

    Spread the loveAre your second graders in need of a laugh? Here’s a list of 25 fun second-grade jokes to keep the day rolling! Which letter has the most water? ...
  • Early Childhood

    25 Funny Thanksgiving Jokes for Kids

    Spread the loveIn need of some Thanksgiving jokes for your students? Calm the excitement with some belly laughs, and one of our favorite corny Thanksgiving jokes for kids. Why did ...

Gifted and Talented Education

  • Gifted and Talented Education

    Twice-Exceptional: What Does it Mean?

    Spread the loveTo be twice-exceptional is to be exceptionally gifted in some academic aspects while being below average compared to peers in other aspects. As a matter of fact, such ...
  • Gifted and Talented Education

    A Guide to Talent Search Programs

    Spread the loveThe Talent Search Initiative has as its aim; the identification of high-performing students by organizing specific tests. Different avenues are then provided for these students to channel their ...
  • Gifted and Talented EducationK-12

    Homogeneous Grouping: What You Need to Know

    Spread the loveThis term refers to the grouping of students by mental capability, aptitude, or hobbies. For instance, gifted students are placed in one group, and students with special needs ...
  • Gifted and Talented Education

    Cluster Grouping: What You Need to Know

    Spread the loveThis term describes a manner of classifying gifted students to place them in properly segmented classrooms. For example, about five to seven extremely bright pupils with comparable skill ...
  • Gifted and Talented EducationHigher Education

    Merit Scholarships: Everything Your Need to Know

    Spread the loveThese are monetary gifts awarded by institutions to superbly gifted students, who have set themselves apart by their exceptional performance in schoolwork, regardless of whether they require the ...

Black Boys in Crisis Series

  • Black Boys in Crisis

    The Importance of Mentoring Young African-American Males

    Spread the loveTeachers need to realize that at home, in their neighborhoods, and in school, many students face difficulties that can interfere with learning. Compared to their middle-class counterparts, it ...
  • Black Boys in CrisisDiversityEquity

    7 Ways That Black Students are Discriminated Against in U.S K-12 Schools

    Spread the loveAfrican Africans have a long history of being mistreated in the United States, starting with slavery. It should come as no surprise that their children face the same ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisChild Development TechClassroom ManagementDigital & Mobile TechnologyDigital LeadershipDisabilitiesEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationK-12Online Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 6: 8 Ways That Digital Age Teachers Avoid Burning Out

    Spread the loveBeing a teacher is a tough job. So much so, many new teachers end up leaving the field within their first three years. To ensure that the next ...
  • Ask An ExpertAssessmentAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementCurrent Ed NewsDigital LeadershipEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEdTech Startups & BusinessesEducation LeadershipEquityFeaturedFirst Year TeachersFreshGamificationGifted and Talented EducationHBCU'sHigh SchoolHigher EducationHigher Education EdTechK-12Matthew LynchModern ParentingOnline Learning & eLearningOpEducationPersonalized LearningPodcastPolicy & ReformRetention & Social Promotion SeriesSpecial EducationSTEMTeacher EducationTeachersTestingYear-Round Schooling

    The Edvocate Podcast, Episode 5: The Archetype of a Great Teacher

    Spread the loveOne of the questions that I am frequently asked is, what does a good teacher look like? I respond by mentioning my 10th-grade Biology teacher, Mrs. Minor, and ...
  • Ask An ExpertAssistive TechnologyBlack Boys in CrisisBullyingChild DevelopmentChild Development TechClassroom ManagementDisabilitiesDiversityEarly ChildhoodEarly Childhood & K-12 EdTechEdTech & InnovationEdTech Policy & ReformEducation LeadershipElementary EducationElementary SchoolEquityFeaturedFirst Year TeachersFreshGifted and Talented EducationHigh SchoolHigher EducationHigher Education EdTechK-12Middle SchoolModern ParentingOnline Learning & eLearningParent & Family TechParentingPersonalized LearningPodcastPolicy & ReformSecondary EducationSTEMTeacher EducationTeachersTesting

    The Edvocate Podcast, Episode 4: How to Create a Culturally Responsive Classroom

    Spread the loveBuilding a culturally responsive classroom is hard. To help you along your journey, here is your guide to exploring and respecting the cultural backgrounds of your students while ...

RSS Matthew on Education Week

  • Au Revoir from Education Futures November 20, 2018 Matthew Lynch
  • 6 Steps to Data-Driven Literacy Instruction October 17, 2018 Matthew Lynch
  • Four Keys to a Modern IT Approach in K-12 Schools October 2, 2018 Matthew Lynch
  • What's the Difference Between Burnout and Demoralization, and What Can Teachers Do About It? September 27, 2018 Matthew Lynch
  • Revisiting Using Edtech for Bullying and Suicide Prevention September 10, 2018 Matthew Lynch

About Us

The Edvocate was created in 2014 to argue for shifts in education policy and organization in order to enhance the quality of education and the opportunities for learning afforded to P-20 students in America. What we envisage may not be the most straightforward or the most conventional ideas. We call for a relatively radical and certainly quite comprehensive reorganization of America’s P-20 system.

That reorganization, though, and the underlying effort, will have much to do with reviving the American education system, and reviving a national love of learning.  The Edvocate plans to be one of key architects of this revival, as it continues to advocate for education reform, equity, and innovation.

Newsletter

Signup for The Edvocate Newsletter and have the latest in P-20 education news and opinion delivered to your email address!

Contact

The Edvocate
5322 Markel Road, Suite 104
Richmond, VA 23230
(601) 630-5238
[email protected]

Follow us

Copyright (c) 2022 Matthew Lynch. All rights reserved.