Persistence of geometric grokking

Establish whether geometric grokking persists as task complexity increases and whether the phenomenon is partly an artifact of the particular arithmetic tasks and interface choices used in the experiments.

Background

The paper uses “geometric grokking” for the emergence of regular, interpretable space-time mechanisms in EM43 that remain valid beyond the training range. The authors explicitly identify as unresolved whether this behavior survives more complex tasks or depends primarily on the selected tasks and interface.