Dice Question Streamline Icon: https://streamlinehq.com

Handle cycles in the moral graph

Develop a principled method for resolving cycles in the moral graph—contexts in which values mutually outrank each other—such as determining when to fracture into personalized models or apply alternative decision mechanisms like voting.

Information Square Streamline Icon: https://streamlinehq.com

Background

The authors anticipate hard power or fundamentally win–lose scenarios that may produce irreconcilable value conflicts represented as cycles in the moral graph.

They currently omit such edges and suggest possible directions (e.g., personalized models or voting) but state they have no process-level resolution.

References

We expect to find such scenarios as cycles in the moral graph. Our process has no answer what to do with these cycles.

What are human values, and how do we align AI to them? (2404.10636 - Klingefjord et al., 27 Mar 2024) in Section 6 (Limitations) – Hard Power