5.3 Computing Bias

What is Bias?

Examples of Bias

• Criminal risk assessment tools are used to determine the chances that a defendant will re-offend, or commit another crime. This information is then used to influence decisions across the judicial process.
  • However, these algorithms are trained to pick out patterns and make decisions based on historical data, and historical data is historically biased against certain races and classes. As a result, risk assessment tools may disproportionally flag people from certain groups as risks.
• Facial recognition systems are often trained on data sets that contain fewer images of women and minorities than white men. Algorithms might be biased by exclusion because they're trained on sets of data that aren't as diverse as they need to be.
• Recruiting algorithms used by companies to help them sort through large quantities of applicants can be biased against certain races or genders. For example, if successful candidates for a position tend to be men because historically only men have applied, an recruting algorithm might teach itself that male candidates are preferred over female ones.

What can we do to prevent bias in computing?

• Use diverse and representative data sets: Using data sets that are diverse and representative of the overall population can help to reduce bias in machine learning models (such as our facial recognition program above).
• Review algorithms for potential biases: Carefully reviewing algorithms for potential biases, and testing them on diverse data sets, can help to identify and mitigate any biases that may be present.
• Incorporate fairness metrics: Using fairness metrics, such as demographic parity or equal opportunity, can help to ensure that machine learning models do not produce discriminatory outcomes.
• Address human bias: It is important to be aware of the potential for human bias in the development and use of technical systems, and to actively seek out and address potential sources of bias.
• Increase diversity in the tech industry: Increasing diversity in the tech industry can help to bring a wider range of perspectives and experiences to the development of technical systems, reducing the potential for bias.