Ensemble Methodology for Reference-Free Confidence Estimation in LLM-based Code Summarization

Administrator 0 阅读

AI Digest - ArXiv AI

Ensemble Methodology for Reference-Free Confidence Estimation in LLM-based Code Summarization

This paper describes an approach and use case to estimate the correctness of LLM-generated COBOL summaries without access to human-authored references. The core intuition is that inter-model agreement on semantics is informative about truth, and that an LLM-as-judge can provide higher-fidelity pairwise assessments than traditional string- or embedding-based metrics. We operationalise this intuition with (i) controlled summary generation from diverse models; (ii) a LLM evaluator that compares pai


Source: ArXiv AI