Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
Judge Reliability Harness
0
Zitationen
6
Autoren
2026
Jahr
Abstract
RAND researchers developed the Judge Reliability Harness (JRH), which provides an end-to-end framework for evaluating the reliability of automated large language model (LLM) judges used in AI benchmarking and evaluation tasks. It generates and executes configurable test suites. By making reliability testing configurable, reproducible, and inexpensive, JRH aims to support more transparent use of LLM judges in research and deployment contexts
Ähnliche Arbeiten
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
2019 · 8.626 Zit.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
2019 · 8.532 Zit.
High-performance medicine: the convergence of human and artificial intelligence
2018 · 8.046 Zit.
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
2019 · 6.843 Zit.
Proceedings of the 19th International Joint Conference on Artificial Intelligence
2005 · 5.781 Zit.