Metric for author visibility and work impact in presentation videos

Establish a clear, operational, and validated metric for quantifying how academic presentation videos enhance the visibility and impact of an author’s work, including a reliable simulation or proxy evaluation procedure suitable for benchmarking and comparison.

Background

Within the Paper2Video benchmark, the authors introduce several evaluation dimensions tailored to academic presentation videos: Meta Similarity, PresentArena, PresentQuiz, and IP Memory. While Meta Similarity and PresentQuiz target content alignment and knowledge conveyance, and PresentArena provides pairwise preference judgments, the dimension concerning the author’s visibility and lasting impact is less well-defined.

Motivated by real conference settings, where audiences who remember a presenter after a talk are more likely to engage later, the authors propose IP Memory as a proxy. However, they explicitly note that devising a clear and simulatable metric for visibility and impact remains an open problem, indicating the need for a rigorous and standardized formulation.