FinAutoRubric: Expert-Guided Automatic Rubric Generation for Evaluating Financial Research Agents

AI Digest - ArXiv AI

FinAutoRubric: Expert-Guided Automatic Rubric Generation for Evaluating Financial Research Agents

Evaluating finance research agents requires rubrics that reflect expert standards and fix the values correct as of an information cutoff. Expert-reviewed finance benchmarks rely on fixed, per-item rubrics, which are costly to extend and cannot encode each institution's own standard. In FinAutoRubric, experts specify reusable evaluation guidance, while agents and code carry out query-specific rubric generation, review, and validation. This expert guidance governs every agent, as prompts and as ru

Source: ArXiv AI