Glossary · E-commerce ML

Algorithmic Fairness

also: ML fairness · fairness in machine learning · disparate impact · demographic parity · equalized odds

Definition

Algorithmic fairness is the study of disparate-impact, demographic-parity, equalized-odds, and related criteria for ML systems making consequential decisions. The Kleinberg/Chouldechova impossibility result (2016) proves that calibration, balance-for-positives, and balance-for-negatives cannot all hold simultaneously when base rates differ across groups.

Algorithmic fairness translates a moral question into a mathematical constraint set. Demographic parity requires equal positive-prediction rates across groups; equalized odds requires equal true-positive and false-positive rates; calibration requires that predicted probabilities mean the same thing across groups. The Kleinberg, Mullainathan, Raghavan 2016 and Chouldechova 2017 impossibility results show that these criteria are mutually incompatible when base rates differ, forcing a deliberate choice rather than a technical one. Production deployments often default to disparate-impact monitoring (Adverse Impact Ratio under the EEOC four-fifths rule) plus explicit bias-audit logging.

Essays on this concept