Dice Question Streamline Icon: https://streamlinehq.com

Cause of the 2024 Shift in Ad-hoc Groundtruth Image Distribution

Determine the primary cause of the reduction in the number and temporal spread of groundtruth images for Ad-hoc tasks in LSC'24 compared to LSC'22 and LSC'23, and assess whether depletion of novel Ad-hoc queries is responsible for the observed shift.

Information Square Streamline Icon: https://streamlinehq.com

Background

The analysis shows that Ad-hoc tasks in 2024 had a substantially lower range and median number of groundtruth images than in previous years, potentially making tasks more challenging by narrowing the acceptable reference space.

The authors suggest this change may be due to the depletion of novel Ad-hoc queries, as many queries had already been used earlier, but explicitly state that the exact reason is unclear.

References

The reason for this shift is unclear, but it may be due to the depletion of novel Ad-hoc queries, as many queries had already been used in previous years.

— The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-24 (2506.06743 - Tran et al., 7 Jun 2025) in Section 4.2 Query Difficulty Analysis, Subsection Number of Groundtruth Images