Extend EVER to support non-rigid objects

Extend the EVER (Edge-Assisted Auto-Verification for Mobile MR-Aided Operation) framework to support non-rigid objects that undergo shape variability and deformation, and develop segmentation and verification techniques that remain reliable under such deformations within the IoU-based auto-verification policy.

Background

EVER is designed and optimized for rigid objects (e.g., LEGO bricks) and uses segmentation of virtual and physical elements with an IoU-based threshold policy for auto-verification. Rigid objects have stable shapes, making mask generation and comparison straightforward.

Non-rigid objects introduce variable shapes and deformations, complicating detection, segmentation, and the reliability of IoU-based verification. The authors explicitly note this limitation and identify extending the system to non-rigid objects as an open challenge and future research direction.