Toward a Gricean Retreat: Probing LLMs for Knowledge Boundaries and Referent Specificity

AI Digest - ArXiv AI

Toward a Gricean Retreat: Probing LLMs for Knowledge Boundaries and Referent Specificity

When asked about entities outside their knowledge boundary, LLMs routinely fabricate plausible-sounding details rather than backing off to safer, more general claims. We frame this failure through a Gricean lens: a cooperative speaker who is uncertain about a referent retreats up the specificity hierarchy, trading informativeness for truthfulness. We ask whether LLMs have the ingredients to perform this retreat. Using a T-REx-based benchmark that varies entity familiarity and referent specificit

Source: ArXiv AI