69传媒

College & Workforce Readiness Q&A

College-Success Algorithms Often Get It Wrong for 69传媒 of Color

By Sarah D. Sparks 鈥 August 02, 2024 3 min read
Illustration of pop up windows and notifications of different programs and applications
  • Save to favorites
  • Print
Email Copy URL

Higher education programs increasingly use algorithms based on students鈥 background, academic achievement, and other factors to predict whether they will complete a degree.

These tools can help direct resources to struggling students, but they can also give a biased picture of students鈥 potential, according to a published by AERA Open, a journal of the American Educational Research Association.

The study describes yet another way that predictive tools can be prone to 鈥渁lgorithmic bias,鈥 in which lacking or missing data make such tools less accurate, or even misleading, when applied to certain demographic populations.

Hadis Anahideh, an assistant professor of industrial engineering at the University of Illinois, Chicago, and her colleagues analyzed federal longitudinal data on students who were 10th graders in 2002 and later entered four-year degree programs. They used a variety of 鈥渃ollege success鈥 models to predict the likelihood that students would complete a bachelor鈥檚 degree within eight years of their high school graduation, and then compared those predictions to students鈥 actual reported educational attainment.

鈥淚t makes [admissions officers鈥橾 job easier because they don鈥檛 have to go through the data one by one,鈥 Anahideh said. 鈥淚f they use these models, which are very powerful, they can estimate, OK, if this is the performance of the new student coming in, based on their high school variable and based on their background information, will they be a successful student? Can they graduate from the program or not?鈥

College-success algorithms falsely predicted failure for about 1 in 5 Black and Hispanic students, the researchers found. By contrast, only 12 percent of white students and 6 percent of Asian students were tapped as likely to fail, when they actually went on to complete a bachelor鈥檚 degree. This kind of flag can be used to target interventions to struggling students, but Anahideh said they could also put students at a disadvantage in admissions and scholarships.

The models also tended to dramatically overestimate how well white and Asian students would do in college relative to other students. Seventy-three percent of Asian students and 65 percent of white students who did not earn a four-year degree in eight years had been predicted to do so. Only a third of Black students and 28 percent of Hispanic students were incorrectly tagged for success.

鈥淭here is a bias right in the system,鈥 Anahideh said. 鈥淏ut the surprising thing in this study was, these common [bias]-mitigation techniques are not really effective. ... There isn鈥檛 one unique solution to address the bias.鈥

Prior research has found datasets used to train predictive tools often don鈥檛 include enough diverse students to teach the tools how to estimate what a successful student of color looks like in the system. But Anahideh and her colleagues found that adding in more examples of successful students from different backgrounds wasn鈥檛 enough to remove bias from the system.

That鈥檚 because linked, increasing the weight they have in the model. For example, average ACT and SAT scores are highly predictive of later college achievement鈥攂ut they are also closely linked to race, and low exam scores can be a less accurate predictor of earning a degree for Black and Hispanic students than white students, the study found.

Educators who work with students transitioning to college can help buffer their students against the effects of algorithmic bias, she said, by 鈥渓earning from this historical data and what the model estimates for these students ... and try to advise them accordingly to be more successful.鈥

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by 
Assessment K-12 Essentials Forum Making Competency-Based Learning a Reality
Join this free virtual event to hear from educators and experts working to implement competency-based education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

College & Workforce Readiness The Way 69传媒 Offer CTE Classes Is About to Change. Here's How
The revision could lead to significant shifts in the types of jobs schools highlight, and the courses students are able to take.
4 min read
Photo of student working with surveying equipment.
E+
College & Workforce Readiness Even in Academic Classes, 69传媒 Focus on Building 69传媒' Workforce Skills
69传媒 work on meeting academic standards. What happens when they focus on different sets of skills?
11 min read
69传媒 participate in reflections after a day of learning in Julia Kromenacker鈥檚 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky. on Wednesday, October 16, 2024.
69传媒 participate in reflections after a day of learning in Julia Kromenacker鈥檚 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky., on Wednesday, Oct. 16, 2024. The Bullitt County district that includes Old Mill Elementary has incorporated a focus on building more general life skills, like collaboration, problem-solving, and communication, that community members and employers consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness Preparing for the Workforce Can Start as Early as 1st Grade. What It Looks Like
Preparing students for college and career success starts well before high school鈥攁nd it doesn鈥檛 only involve occupation-specific training.
5 min read
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps her student Lucas Joiner on an online learning assignment on Wednesday, October 16, 2024.
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps student Lucas Joiner on an online learning assignment on Wednesday, Oct. 16, 2024. The Bullitt County district, which includes Old Mill Elementary, has incorporated a focus on equipping students with more general life skills鈥攍ike communication, critical thinking, and problem-solving鈥攖hat employers and community members consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness What the Research Says How Well Do Dual-Credit 69传媒 Do in College? A Look in Charts
New data show some students get more access鈥攁nd more leverage鈥攆rom taking postsecondary classes in high school.
3 min read
Illustration of students
Muhamad Chabib alwi/iStock/Getty