Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 15 Oct, 15:07 | Waiting for check | |
| SURD-BENCH: BENCHMARKING UNIFIED MULTI Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| MEMTRACE: TRACING AND ATTRIBUTING ERRORS Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| REASONOPS: OPERATOR SEGMENTATION FOR LLM ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| FROM FACT OVERWRITING TO CAUSAL EDITING Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| MEmoS2S-Bench: An Open-Ended Benchmark for ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| WORLD DISTILLATION FOR SCAL Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| EARTHARENA: BENCHMARKING AGENTS ON REAL Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | Waiting for check | |
| Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 13 Oct, 06:18 | Waiting for check | |
| QUANTITATIVEFINANCE-BENCH: BENCHMARKING AI ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| PARALLAX:ATWO-PHASE DEFENSE FOR MEMORY- ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| MLP-BENCH: TOWARDS END-TO-END FORMAL ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| TRUST, BUT VERIFY: A FRONTIER MODEL BENCH- ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| Proceedings of the 1st International Workshop on Harness Engineering for Generative UI: Everything Evolves, Something Endures The publication compiles the proceedings of the first international workshop on harness engineering for generative user interfaces. Not a research paperPeer-reviewed | LLM evaluation and benchmarks via acm · 12 Oct, 18:41 | Not relevant Summary is too thin to evaluate. | |
| SELECTION IS NOT LEARNING: CHOOSING MODEL ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| ADAPTIVE SELF-DISTILLATION FOR LLM REASON- ING Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:41 | Waiting for check | |
| LLM-Based Pairwise Judgment for Math Item Parameter ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| How Long Reasoning Chains Influence LLMs’ Judgment of Answer Factuality - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| All Prompts Are Created Equal? Evaluating Robustness of LLM Judges Against Non-Adversarial Prompt Variations - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| Prior Beliefs Prejudice LLM-as-Judge: Evidence from Persuasion Evaluation - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| Can LLMs Judge Pedagogy? Assessing Conversational AI ... Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| HOW LLMS ADAPT TO HIDDEN EVALUATION RULES Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via openreview · 12 Oct, 18:08 | Waiting for check | |
| Aggregate vs. Personalized Judges in Business Idea Evaluation: Evidence from Expert Disagreement - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| PROBE: PROcess-Based BEnchmark for Hallucination Detection - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check | |
| TripTide: A Benchmark for Adaptive Travel Planning under Disruptions - ACL Anthology Summary pending (next check). Could not confirmPreprint | LLM evaluation and benchmarks via acl · 12 Oct, 18:08 | Waiting for check |
1–25 of 25