Trade-off Between Coverage and Source Quality in AI Knowledge Systems
Determine principled methods to trade off topical coverage against source quality when constructing AI-powered knowledge systems, so that the breadth of addressable topics is balanced with the verifiability and reliability of sources.
References
A core open question in building AI-powered knowledge systems is how to trade off coverage (the breadth of topics a system can address) against source quality.
A deployment could reserve budget for broader exploration and monitor coverage across languages and content types, but the effectiveness of these measures remains to be evaluated.
What our experiments do not isolate is a query that is far from every indexed domain in representation space. Since what matters for selection is proximity in that space rather than shared domain membership, such a query may retrieve weakly related neighbors, and characterizing when the knowledge-base coverage is insufficient, and how to build a knowledge base that avoids it, is left for future work.