Dice Question Streamline Icon: https://streamlinehq.com

Develop appropriate ethical assessment criteria for ADMS

Develop and justify appropriate ethical assessment criteria for automated decision-making systems (ADMS) that can be applied within ethics-based auditing to evaluate ethical performance across contexts.

Information Square Streamline Icon: https://streamlinehq.com

Background

EBA requires concrete, applicable criteria to assess whether ADMS align with ethical principles. The authors highlight that selecting or formulating suitable criteria remains unresolved and is essential for practical auditing across diverse applications and contexts.

References

To mention a few: was the right ADMS built, and was it build right? (Dobbe et al., 2019); what are the appropriate ethical assessment criteria for ADMS? (D'Agostino & Durante, 2018); what should be included when documenting the origin of a dataset or the design of an ADMS? (Raji et al., 2020); how to account for the power asymmetries between system owners, regulating bodies and decision-subjects when designing EBA procedures? (Crawford et al., 2019); and, who within STS is responsible for distributed moral action? (Floridi, 2016b). These questions are left for future research.

— Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications (2111.04380 - Mokander et al., 2021) in Section 5 (Discussion: limitations and risks associated with EBA), paragraph beginning “It should also be noted that when analysing STS...”