When does the compositional OVI stopping criterion work well?

Establish whether the compositional optimistic value iteration stopping criterion performs well when the likelihood of reaching all individual open MDPs is high, and delineate the conditions under which this advantage holds.

Background

The optimistic global stopping criterion adapts OVI to the compositional setting. The authors observe experimentally that this criterion appears favorable when all component parts are likely to be reached.

A theoretical explanation of this phenomenon would help practitioners select termination strategies based on model characteristics.