Presentation Title

Leveling the Field: Developing a Coding System to Identify Cultural Bias in International Test Comparisons

Faculty Mentor

Dr. Guillermo Solano-Flores

Start Date

18-11-2017 2:00 PM

End Date

18-11-2017 2:15 PM

Location

15-1822

Session

Social Science 3

Type of Presentation

Oral Talk

Subject Area

education

Abstract

While it is impossible to ensure one hundred percent equity amongst International Large Scale Assessments (ILSA), there are methods of minimizing potential sources of bias. One way is to be sensitive to the cultural reality of the target demographic. We know from our understanding of cultural validity that one’s social reality largely affects how they are able to make sense of the world, or in this case, a test item. To check for cultural validity on ILSA exams, we created a coding system that filters for potential sources of cultural bias that could potentially create inequity between different countries/cultural groups. By reviewing test items in mathematics and science from the Programme for International Student Assessment (PISA), we sought to identify error types. We then created categories that would identify these potential sources of bias. We ended up identifying nine categories where cultural bias could potentially reside. Future steps with this project would be to lend this coding system to ILSA test makers to apply the codes and receive their input on the validity and effectiveness of the codes.

This document is currently not available here.

Share

COinS
 
Nov 18th, 2:00 PM Nov 18th, 2:15 PM

Leveling the Field: Developing a Coding System to Identify Cultural Bias in International Test Comparisons

15-1822

While it is impossible to ensure one hundred percent equity amongst International Large Scale Assessments (ILSA), there are methods of minimizing potential sources of bias. One way is to be sensitive to the cultural reality of the target demographic. We know from our understanding of cultural validity that one’s social reality largely affects how they are able to make sense of the world, or in this case, a test item. To check for cultural validity on ILSA exams, we created a coding system that filters for potential sources of cultural bias that could potentially create inequity between different countries/cultural groups. By reviewing test items in mathematics and science from the Programme for International Student Assessment (PISA), we sought to identify error types. We then created categories that would identify these potential sources of bias. We ended up identifying nine categories where cultural bias could potentially reside. Future steps with this project would be to lend this coding system to ILSA test makers to apply the codes and receive their input on the validity and effectiveness of the codes.