AI 中的偏见
定义
AI 中的偏差指的是系统性错误或不公平的结果 (例如 across demographics) arising from data, model 设计, or deployment. Mitigation includes data audits, fairness metrics, and debiasing methods.
它是 a core concern in AI ethics and AI safety. Evaluation metrics for fairness (例如 demographic parity, equalized odds) are used in audits and before deploying in regulated domains. Explainable AI can help identify when and why bias appears.
工作原理
Bias can enter 通过偏斜的训练数据 (underrepresentation, label bias), proxy variables (例如 zip code for race), or feedback loops (model outputs influence future data). Detection uses fairness metrics (例如 demographic parity, equalized odds, calibration by group) on evaluation sets stratified by protected attributes. Mitigation includes: data (reweighting, resampling, collecting more representative data); training (fairness constraints, adversarial debiasing); and post-processing (thresholds or rules per group). Trade-offs exist between fairness metrics and accuracy; legal and domain norms define which metrics and thresholds to use. Audits should be run before deployment and monitored in production.
应用场景
Bias work applies when model 决策s affect people in regulated or sensitive domains (hiring, lending, scoring, content).
- Auditing hiring, lending, or scoring systems for discriminatory impact
- Fairness checks before deploying models in regulated domains
- Explainability and remediation when bias is detected