On measurement, superdeterminism, free will, and contextuality

Abstract: Superdeterminism has received recent attention as a possible path toward a locally causal explanation of the entanglement correlations that appear in experimental tests of Bell's theorem. While the term `superdeterminism' was coined by Bell to refer to restrictions on the free will of experimenters, it was not rigorously defined until recently. It has now been defined as a property of any physical theory that produces systematic violations of statistical independence. Here we focus on formalizing the requirements that being nonsuperdeterministic places on a physical theory, and setting a standard that must be met before we can conclude that a given theory is not superdeterministic. We begin by carefully examining how a physical theory determines what outcomes we observe when performing measurements in terms of ontic states and response functions, and how this differs between superdeterministic and nonsuperdeterministic theories, in terms of the behavior of the types of vetted random sampling procedures that we use in experiments. The core result is that individual samples and measurement outcomes must be representative of the observed distributions, which is explained in detail. This also has a bearing on how measurement settings are chosen by agents, whether freely or randomly, and we argue that this standard ultimately defines what freedom/independence actually mean. We then discuss contextuality, and show that in most cases, superdeterminism is contextual. Finally, we discuss how different physical theories, with different notions of ontic states and response functions, can give rise to the same empirical data, and how the same operational contextuality may appear in different forms.

• The paper rigorously formalizes the nonsuperdeterminism criterion, linking statistical independence with agent free will through precise preparation and measurement response functions.
• It clarifies both preparation and measurement contextuality by distinguishing between separable and nonseparable ontologies using operational metrics.
• The analysis imposes strict constraints on quantum theories, urging explicit mechanisms to preserve randomness and ensure empirical representativeness.

Formal Constraints on Superdeterminism, Free Will, and Contextuality in Quantum Theory

Overview

The paper "On measurement, superdeterminism, free will, and contextuality" (2604.00311) provides a rigorous analysis of foundational issues in quantum theory, particularly focusing on the role of superdeterminism, measurement, statistical independence, and the relationship to contextuality. The work systematically formalizes what must be required for a theory to be classified as nonsuperdeterministic, articulates the implications for agent freedom and free will, and elucidates the connections and separations between preparation and measurement contextuality.

Measurement, Ontic States, and Response Functions

A foundational distinction is made between ontic states $\lambda$ (the underlying, possibly hidden, states of a system) and operational mechanisms for selecting and measuring these states. The analysis builds upon the ontological models framework and emphasizes the need for physical theories to specify:

• Preparation Response Functions: $\rho(\lambda|p)$, describing the (relative) frequencies or distributions over $\lambda$ induced by preparation procedures $p$.
• Measurement Response Functions: $\xi(k|M, \lambda)$, assigning outcome probabilities or frequencies for measurement procedure $M$ on state $\lambda$.
• Generalized Response Functions: $\mathcal{R}(k|M,p)$, encoding the empirical statistics for outcome $k$ under measurement $M$ after preparation $\rho(\lambda|p)$0.

A notable clarification is made between the types of theories considered: separable versus nonseparable ontologies, deterministic versus indeterministic dynamics, and the subtlety of identifying ensembles and their subensembles in theories with holistic or strongly entangled ontologies.

Superdeterminism and the Statistical Independence Standard

The paper precisely defines superdeterminism as a violation of statistical independence (SI): when the selection procedure for ontic states, even using good (randomized or agent-based) sampling, systematically produces nonrepresentative samples relative to the underlying ensemble. In superdeterministic frameworks, randomization by the agent (via protocols or "free" choices) does not guarantee SI, and thus observed frequencies can display correlations that would be ruled out in nonsuperdeterministic theories.

The formal criterion established is: for a theory to be nonsuperdeterministic, every individual outcome produced by a generalized response function $\rho(\lambda|p)$1 must be representative of the empirically plausible distribution $\rho(\lambda|p)$2. This ensures that neither random sampling procedures nor agent choices are subject to hidden correlations enforced by the physical theory’s mechanisms.

This standard encompasses both preparation and measurement settings, imposing a symmetric requirement:

• Agent's Free Will: The measurement choices made by agents must not be correlated with ontic states in a way that would restrict their distributions to nonrepresentative subsets.
• Randomness in Preparation: Each application of a "good" random sampling procedure must produce ontic states with frequencies matching the full ensemble, preserving representativeness.

Implications for Interpretations of Quantum Theory

The formalism directly challenges theorists to explicitly articulate the mechanisms by which their theories avoid or invoke superdeterministic correlations. For instance:

• Bohmian Mechanics and Everettian Quantum Theory: These frameworks, which possess nonseparable ontologies, readily admit the possibility for (and in some cases, require) such correlations, raising the bar for proof of nonsuperdeterminism within their formalism.
• Separable Theories: The analysis favors separable ontologies that, by construction, ensure that preparation and measurement choices are independent and that ensembles can be consistently understood.

The results imply that theoretical claims of locality or agent independence in quantum interpretations must be scrutinized for their ability (or lack thereof) to meet the proposed nonsuperdeterminism standard.

Contextuality: Preparation and Measurement

A significant portion of the paper is devoted to the clarification of contextuality in its operational and ontological forms:

• Preparation Contextuality: Superdeterministic theories, by virtue of violating SI, are generically preparation contextual. If two operationally equivalent preparations $\rho(\lambda|p)$3 and $\rho(\lambda|p)$4 yield distinct distributions $\rho(\lambda|p)$5, the theory is preparation contextual.
• Measurement Contextuality: The measurement response function may depend on the broader measurement context—a well-established feature of quantum mechanics under the Kochen-Specker theorem.

The analysis makes explicit that apparent measurement contextuality in empirical statistics can be reframed as (superdeterministic) preparation contextuality if the preparation procedure distribution is allowed to depend on the measurement setting; this is associated with retrocausal or "conspiratorial" mechanisms.

Critically, the empirical indistinguishability between these mechanisms—where violations of preparation noncontextuality can "simulate" measurement contextuality—demonstrates the importance of theoretical assumptions about SI in interpreting operational results.

Formal and Practical Implications

The formalism places a nontrivial constraint on physical theorizing about quantum foundations:

• Theory Construction: Proponents of any quantum theory or interpretation must transparently detail both preparation and measurement response mechanisms and directly address the SI standard.
• Experimental Design: The operational connection between agent choices, preparation procedures, and the representativeness of outcome statistics impacts the interpretation of Bell-type experiments and the evaluation of quantum nonlocality or contextuality.
• Retrocausal/Contextual Frameworks: Alternative models, including retrocausal or explicitly contextual ontologies, require nuanced handling under this analysis, as their predictions and ontic assignments can be mapped to different contextuality structures.

Future lines of research suggested by this formalism include the search for operational signatures of specific contextuality classes, the development of new interpretational models that satisfy the SI standard yet accommodate quantum empirical data, and the clarification of locality constraints given these refined definitions.

Conclusion

This work rigorously formalizes the requirements for nonsuperdeterminism in physical theories, connecting foundational aspects of measurement, agent freedom, and contextuality. By articulating an explicit, demanding standard for statistical independence and representativeness, the analysis imposes strong constraints on the construction and interpretation of quantum theories, clarifies the meaning and empirical roles of contextuality, and suggests pathways for future theoretical and experimental inquiry regarding the foundations of quantum mechanics and the nature of free will in physical law.