Inherent (and Dangerous) Racism in Medical Algorithms

September 2, 2020

Ndome Yvonne Essoka

“In 2019, Optum’s medical algorithms were flagged for underestimating the needs of the sickest Black patients in its system,” writes Ndome Yvonne Essoka.

“Hospitals and insurers all over the country use these algorithms daily to make healthcare decisions for hundreds of millions of Americans in the U.S. each year. The error highlighted flaws within healthcare technology that perpetuate medical racism and contribute to current health inequities and disparities.”

Here’s an excerpt from her new article for us:

How can a technology created to save patients be inherently racist? The simple yet confusing answer to this conundrum is that these algorithms bear implicit biases.

Optum’s algorithm uses a rule-based system, but this rule-based review is based on historical spending, which is skewed, as we’ll see. Optum’s technology is not an outlier; it is part of a broader pattern of medical algorithms that define contributing factors too narrowly, without considering the big picture.

Algorithm developers typically do not examine factors that go along with race and cost of care in the U.S. such as access to primary care, socioeconomic status, or discrimination. These missing pieces may be solved by including other proxies such as class and poverty, which are often stratified through race.

In 2016, for example, the household income for Black Americans was $39,500 compared with $65,000 for non-Hispanic White Americans. Explanations for this include residential segregation, redlining, discrimination, and differences in family structure, to name a few.

To attempt to create race-neutral technology, medical algorithms base their data mainly on medical costs. In theory, this technology should be extremely beneficial to overworked healthcare providers, and in many regards it is. But because of the U.S.’s unique racial makeup and deeply embedded history of structural racism, these modern day race-neutral costs are essentially skewed.

Read the full article now: Medical Algorithm Technology and Its Fatal Flaw: An Implicit Bias

Best regards,
Matt Humphrey

Start Your Online Access Today

Not a member yet?
Sign up for a FREE trial membership »

And don't forget: Once you've signed up as a member, you can add up to 9 colleagues for no additional charge with our Group Membership Upgrade. It's an incredible value.