Dice Question Streamline Icon: https://streamlinehq.com

Optimal rates for online calibration

Determine the optimal convergence rates, as functions of T and the prediction dimension d, at which calibration error can be driven to zero in adversarial online settings.

Information Square Streamline Icon: https://streamlinehq.com

Background

Calibration ensures forecasts are unbiased conditional on their own values and guarantees diminishing swap regret for agents who best respond to them. However, known algorithms achieve rates like T{2/3} in one dimension and rates that degrade exponentially with dimension, and there is a one-dimensional lower bound ruling out O(\sqrt{T}) rates.

The authors highlight that the exact optimal rates for online calibration remain an important open question, motivating their pursuit of alternative forecasting notions that yield stronger guarantees for downstream agents.

References

The correct 'rates' at which calibration error can be driven to 0 in an online setting has been an important open question; the best known rates in 1 dimension are T{2/3} and degrade exponentially with the dimension.

Forecasting for Swap Regret for All Downstream Agents (2402.08753 - Roth et al., 13 Feb 2024) in Related Work, first paragraph