Determine whether larger or better-tuned detectors improve arXiv performance

Determine whether a larger or better-tuned fine-tuned detector can achieve higher in-domain macro-F1 scores on the arXiv subsets than the reported DeBERTa-v3-base baseline.

Background

The paper evaluates a single fine-tuned detector architecture, DeBERTa-v3-base, at one model size, using three training epochs and best-epoch selection across three random seeds. Its in-domain macro-F1 scores on the arXiv subsets are substantially below the corresponding shared-task results. The paper attributes this gap primarily to the SentencePiece tokenizer’s inability to represent the whitespace artifact that dominates those benchmarks, but explicitly leaves unresolved whether model capacity or hyperparameter tuning could yield higher scores.