2000 character limit reached
PyTerrier-GenRank: The PyTerrier Plugin for Reranking with Large Language Models (2412.05339v1)
Published 6 Dec 2024 in cs.IR, cs.AI, and cs.CL
Abstract: Using LLMs as rerankers requires experimenting with various hyperparameters, such as prompt formats, model choice, and reformulation strategies. We introduce PyTerrier-GenRank, a PyTerrier plugin to facilitate seamless reranking experiments with LLMs, supporting popular ranking strategies like pointwise and listwise prompting. We validate our plugin through HuggingFace and OpenAI hosted endpoints.