Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Measuring and Reducing Unusable Replies of LLM Agents The paper measures whether requester users can understand multi-step agent replies and evaluates how explicit constraints improve reply usability. Ranked #361New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a metric and reader-model benchmark to measure reply usability of LLM agents. | |
| Divergent Paths: Learning an Outcome-Predictive Representation of LLM Agent Trajectories The paper learns trajectory embeddings to predict the success or failure of language model agents early during execution. Ranked #362New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates trajectory outcome prediction across multiple standard LLM agent benchmarks. | |
| ReproBAIT: Can coding agents build their own biological AI tools? This paper introduces a benchmark evaluating whether coding agents can reimplement and train biological AI tools from published scientific papers. Ranked #363New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a benchmark evaluating coding agents on replicating biological software tools. | |
| LabOPBench: A Multimodal Benchmark for Evidence-Grounded Laboratory Decision Making This paper introduces a multimodal benchmark evaluating AI models on evidence-grounded decision making in chemistry and materials laboratories. Ranked #364New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a multimodal benchmark evaluating evidence-grounded scientific decision-making. | |
| EvoProbe: Evaluation-Driven Benchmark Evolution for LLM Agents The paper introduces an evaluation framework that diagnoses bottlenecks and dynamically regenerates benchmark tasks for language model agents. Ranked #365New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a dynamic evaluation benchmark tackling saturation and contamination. | |
| Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction The paper introduces a multilingual benchmark to evaluate how language models identify financial concepts and extract supporting numerical evidence. Ranked #366New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a benchmark evaluating multilingual financial grounding and extraction. | |
| Evaluating Agentic Capabilities Before Post-Training: An End-to-End Approach The paper presents an evaluation framework to test the interactive agentic capabilities of base language models before post-training. Ranked #367New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes an evaluation framework to assess agentic capabilities during pretraining. | |
| DANGERLENS: Probing Dangerous Representations Hidden by Safety Alignment The paper introduces an internal probing method to detect whether safety-aligned language models still retain accessible representations of hazardous concepts. Ranked #368Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces an auditing method to probe and evaluate whether safety alignment actually hides dangerous concepts. | |
| Tail Competition Explains Scaling in Best-of-N Sampling for Verifiable Problems The paper analyzes Best-of-N sampling as an extreme-value competition between tails of correct and incorrect responses to explain reward hacking. Ranked #369New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Analyzes reward model behavior and reward hacking failure modes in inference scaling. | |
| Can We Believe AI Peer Review? The paper evaluates the reliability, score variance, and consistency of automated peer reviews generated by large language models. Ranked #370Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates the reliability, score variance, and consistency of LLM-as-a-judge for peer review. | |
| Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources The paper introduces a framework to audit cultural, geographic, and user-representation biases embedded within popular machine learning benchmarks. Ranked #371New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a user-centric audit framework to uncover biases and scoring flaws in existing benchmarks. | |
| ListQA: A Benchmark for Evaluating List-Formatted Factual Knowledge Retrieval in Large Language Models The paper introduces an evergreen benchmark to evaluate the ability of language models to retrieve and format multi-element factual lists. Ranked #372New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a new benchmark and grading methodology evaluating list-formatted factual knowledge retrieval. | |
| ChronoCulture: Evaluating Cultural Awareness Across Time in Large Language Models This paper introduces ChronoCulture to evaluate how well language models capture temporal changes in cultural attitudes across 72 countries. Ranked #373New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces ChronoCulture, a benchmark evaluating how large language models capture evolving cultural attitudes. | |
| Same Claim, Different Interpretations: How LLM Agents Resolve Ambiguity in Scientific Claims This paper proposes Claim Cards to make agent interpretations explicit when verifying ambiguous natural-language scientific claims. Ranked #374New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Critiques scientific verification benchmarks where implicit interpretations distort evaluation scores against ground truth. | |
| DivAlgo: A systematic evaluation of algorithmic diversity for code generation models The paper introduces a benchmark and similarity metric to measure the algorithmic diversity of solutions produced by code generation models. Ranked #375Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents the DivAlgo benchmark and a similarity metric to evaluate code generation models. | |
| What Is a Clarification? Estimating Model-Dependent Input Ambiguity The paper formalizes clarification criteria to estimate model-dependent input ambiguity based on accessible and valid answers. Ranked #376New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a black-box methodology to evaluate and quantify model-dependent input ambiguity. | |
| SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric Judges The paper systematizes grading requirements for open-text legal exams and compares eight evaluation paradigms using human and model judges. Ranked #377New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Analyzes LLM-as-a-judge reliability, rubrics, and evaluation methodology for complex open-text answers. | |
| RCCM: Diagnosing Gains and Harms in Reasoning-Prompt Transfer The paper analyzes question-level variations and prompt-execution mismatches when transferring reasoning prompts across different language models. Ranked #378Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents an evaluation framework analyzing mismatches and hidden degradation in reasoning-prompt benchmarks. | |
| How to Evaluate When You Don't Know How to Evaluate? Choosing Reliable Setups for Base Language Model Benchmarking The paper investigates base language model benchmarking setups to identify evaluation configurations that produce consistent, non-random, and monotonic performance signals. Ranked #379New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Investigates evaluation setups and signal criteria for reliable LLM benchmarking. | |
| Fantastic Metrics and How to Find Them: Meta-Evaluating Metrics for Multi-lingual Style-Personalized Generation The paper proposes a regression-based meta-evaluation framework and benchmark to assess text evaluation metrics for multilingual style-personalized generation. Ranked #380Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a meta-evaluation framework and benchmark to assess text evaluation metrics and LLM judges. | |
| J-tau: A Fully Localized Japanese Benchmark for Tool-Agent-User Interaction The paper introduces a localized Japanese benchmark for evaluating tool-using conversational agents in customer-support scenarios. Ranked #381New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents a localized benchmark and fixes scoring flaws in tau-bench for agent evaluation. | |
| On the Limits of Representation-Based Test-Time Adaptation for Multimodal LLMs Analyzes why feature-based test-time adaptation fails to recover accuracy on corrupted inputs in generative multimodal language models. Ranked #382Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates corruption robustness and test-time adaptation limits in multimodal LLMs. | |
| AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions The authors develop a clinical benchmark evaluating language model pipelines for generating multidisciplinary second opinions on complex medical cases. Ranked #383New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a multi-dimensional benchmark evaluating LLM diagnostic reasoning against calibrated judges. | |
| GraphACM: Graph-based Action Consistency Measurement for Uncertainty Quantification in LLM Agents The paper builds state graphs across multiple agent rollouts to evaluate behavioral consistency and predict execution failures. Ranked #384New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a graph-based metric and framework to evaluate agent uncertainty and execution reliability. | |
| Selection Is Not Learning: Choosing Model Futures The paper separates task generation from model update inheritance to avoid compounding errors in self-evolving language model loops. Ranked #385Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Analyzes evaluation-driven model inheritance decisions and selection error in self-evolving LLM loops. | |
| OntoAct: Hypothesis-Based Neuro-Symbolic Agents through Ontological Abstraction The paper pairs language models with symbolic verifiers to test and update reusable hypotheses for environment diagnostics and repair. Ranked #386New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces Tacit-FLE, a new benchmark for diagnosing and repairing hidden system faults. | |
| AgentPerturb: Evaluating LLM Agent Robustness under Controlled Interaction Perturbations The authors introduce a framework to benchmark language model agent robustness under interaction perturbations across diverse tasks. Ranked #387New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Proposes a benchmark framework to evaluate agent robustness under noise. | |
| When Does Muon Actually Win? A Paired Data-, Time-, and Tuning-Budget Benchmark The paper compares the Muon optimizer against AdamW across controlled data, wall-clock time, and tuning budgets. Ranked #388Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Provides a controlled benchmark comparing optimizers across data and time budgets. | |
| Can LLMs Tell Stories Out of Order? A Corpus and Benchmark for Nonlinear Narrative Generation Introduces a benchmark and evaluation to test whether language models can successfully generate coherent nonlinear narratives. Ranked #389New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a new benchmark and evaluation methodology assessing nonlinear narrative reasoning in LLMs. | |
| ARGUS: An Agenda-Driven Framework for Reliable User Simulation The paper introduces an agenda-driven neuro-symbolic framework to improve the reliability of user simulation when testing interactive conversational agents. Ranked #390New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces an agenda-driven evaluation framework and rubric-based metric for agents. | |
| A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models Estimates language model ensemble member reliability from unlabeled agreement patterns using an expectation-maximization jury formulation. Ranked #391New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents a label-free reliability estimation and aggregation method for evaluating and ensembling LLMs. | |
| OmicsBench: a long-horizon multi-turn benchmark of AI agents on research-study-scale bioinformatics Presents a multi-turn benchmark measuring language agent capabilities on complex, long-horizon bioinformatics workflows. Ranked #392New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces OmicsBench, a multi-turn benchmark for testing long-horizon agent capabilities. | |
| PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews Combines language models and lightweight decision models to fact-check statements in peer reviews against original manuscripts. Ranked #393New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces ReviewFact, a new benchmark measuring fact-checking accuracy, cost, and latency. | |
| What do AI chatbots do after users decline therapeutic redirection for suicide thoughts? Audits how persistent conversational agents remain with therapeutic crisis referrals after users repeatedly refuse help for suicidal thoughts. Ranked #394Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Audits and measures conversational safety behaviors of commercial chatbots across standardized test conversations. | |
| Entertain, then Cancel: How Thinking Makes Reasoning Models Read Some and Or Literally Examines how extended reasoning steps lead language models to interpret everyday logical terms strictly literally instead of inferring pragmatic meaning. Ranked #395Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Examines evaluation pitfalls in how reasoning models interpret pragmatic language constructs. | |
| AgentEval: Evidence-Bounded Assessment of Stateful Agents Presents an evaluation system that tracks state and evidence to ensure autonomous agents fulfill obligations across long-horizon executions. Ranked #396New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a system and methodology for evaluating stateful agent actions and evidence. | |
| Open Benchmark of AI Impact on Humans (ImpactBench): an expert-guided, open platform for the holistic evaluation of AI impact on humans The paper introduces an expert-guided benchmark to measure the impact of generative language models on user wellbeing. Ranked #397New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces ImpactBench, an expert-guided benchmark measuring conversational model impacts across 809 metrics. | |
| INCONVENIENT: A Benchmark to Assess LLM Generalization Capabilities from Convenience Samples Introduces a benchmark to test model generalization under systematic convenience sampling biases in tabular data. Ranked #398New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a benchmark assessing model generalization and robustness under sampling bias. | |
| QuasiLeak-Bench: Evaluating LLM-Based Privacy Detectors on Policy-Conditioned Quasi-Evidence Group Recovery The paper introduces QuasiLeak-Bench to evaluate whether privacy detectors can identify distributed quasi-identifiers governed by disclosure policies. Ranked #399New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces QuasiLeak-Bench, a new benchmark evaluating privacy detection on quasi-evidence groups. | |
| Beyond Retrieval Failure: Understanding Why LLMs Miss Evidence in Multi-Hop RAG The paper introduces ExecutionRAG to show how search drift causes apparent retrieval failures in multi-hop question answering. Ranked #400New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Provides diagnostics and evaluation methodology for retrieval failures in multi-hop systems. | |
| Abstracts or full text? Evaluating input scope and computational efficiency in biomedical lay summarization Compares abstract-only versus full-text inputs and few-shot versus fine-tuning approaches for generating biomedical lay summaries. Ranked #401Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Systematically evaluates model performance and factual consistency across input scopes. | |
| No Single Tokenizer Feature Reliably Predicts Downstream Language Model Performance Shows across 200 models that proposed intrinsic tokenizer metrics do not reliably predict downstream language model performance. Ranked #402Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Evaluates intrinsic tokenizer metrics against downstream performance across 200 models. | |
| From Perception to Prediction and Intervention: Benchmarking Proactive Video Assistants in Real-Life Scenarios The paper introduces a benchmark to evaluate proactive video assistants across perception, risk prediction, and timely real-world intervention tasks. Ranked #403New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:18 | On-topic Introduces a benchmark evaluating proactive video assistants across perception, risk prediction, and intervention. | |
| RDL-Bench: A Benchmark for Task-Aware Question Answering over Relational Databases The paper introduces a benchmark to evaluate question answering systems on reasoning and predictive tasks over relational databases. Ranked #404New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:18 | On-topic Introduces RDL-Bench, a new benchmark for evaluating natural-language question answering over relational databases. | |
| Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition Introduces AAArena, a benchmark evaluating how AI agents revise executable code policies across 12 adversarial games under fixed budgets. Ranked #405New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces AAArena, a new benchmark of 12 games to evaluate agent heuristic learning. | |
| WorldCast: Exploring Intelligent Visual Generation in World State Prediction The paper introduces a hierarchical benchmark for evaluating visual generative models on multi-step world state prediction tasks. Ranked #406New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces WorldCast, an evaluation benchmark measuring multi-step visual state prediction capabilities. | |
| OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling Proposes a visual verifier that decomposes complex prompts into sub-questions and assigns continuous scores to improve multimodal evaluation. Ranked #407New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents a decomposed graded verifier framework for evaluating generative multimodal models. | |
| APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation This paper introduces an agentic post-training framework that coordinates multiple agents to evaluate and adaptively train text-to-image models. Ranked #408New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Builds automated evaluation set generation and capability diagnostic harnesses for image models. | |
| AMLworld-Compact: Importance-Weighted Downsampling for Cost-Effective LLM Evaluation and Error Diagnosis The paper presents an importance-weighted downsampling protocol to lower evaluation costs on transaction graph datasets without distorting precision metrics. Ranked #409New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces an importance-weighted downsampling protocol and benchmark set for cost-effective LLM evaluation. | |
| Evaluating LLM Creativity through Long-Tail Performance Formalizes language model creativity evaluation as long-tail input-output distribution performance and tests it across multiple benchmarks and models. Ranked #410New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Critiques existing creativity benchmarks and proposes a new evaluation metric for long-tail performance. | |
| One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation Deconstructs multiple-choice option bias in language models into two factors tracking answer flips and positional skew. Ranked #411New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Analyzes selection bias and order sensitivity flaws in multiple-choice benchmarks. | |
| AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning Introduces an adaptive curriculum reinforcement learning method to train multimodal models on long-horizon visual Sudoku reasoning tasks. Ranked #412New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces FG-Sudoku, a fine-grained benchmark evaluating long-horizon multimodal deductive reasoning. | |
| Towards Easier-to-Tune Training Algorithms: New Results from AlgoPerf Evaluates deep learning optimizers under a self-tuning fixed-hardware benchmark across nine distinct workloads. Ranked #413New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | On-topic Evaluates deep learning optimizers using the AlgoPerf benchmark suite across multiple workloads. | |
| PPG-Bench: A Unified Benchmark for PPG Foundation Models Introduces a unified benchmark evaluating five public photoplethysmography foundation models across nine datasets and 26 clinical and wearable tasks. Ranked #414New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | On-topic Introduces a unified benchmark evaluating foundation models across multiple datasets, tasks, and probing regimes. | |
| MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph Introduces a benchmark evaluating vision-language models on graph-theoretic reasoning where evidence is split across multiple visual graph views. Ranked #415New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a new benchmark and diagnostic tasks to evaluate vision-language models. | |
| Natural Language to First-Order Logic LLM-based Autoformalization The paper reviews LLM-based first-order logic autoformalization, distinguishing ontology extraction from logical translation and outlining key benchmarking challenges. Ranked #416New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Analyzes evaluation metrics, benchmarking gaps, and task formulation in first-order logic autoformalization. | |
| ChemArgus: Automated Scientific Diagnostics for Lab-Grade Multimodal Chemistry Reasoning: A Frontier Benchmark The paper presents a multimodal benchmark for competition-level chemistry that grades reasoning step-by-step with partial credit. Ranked #417New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a fine-grained multimodal diagnostic benchmark for evaluating scientific and chemistry reasoning. | |
| Jev-ToM: Evaluating Theory of Mind in Typed Decision Models The paper introduces a benchmark to evaluate how typed decision models handle theory-of-mind reasoning tasks compared to standard generative language models. Ranked #418New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces Jev-ToM, an extensive evaluation benchmark comparing models on Theory of Mind tasks. | |
| Decomposing and Predicting Annotation Disagreement in Harmful Content Across Languages This paper predicts human annotator disagreement on harmful content across multiple languages by extracting interpretable semantic question features with models. Ranked #419New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes annotator disagreement and benchmark annotation quality across multiple languages. | |
| Worth Their Weights? Evaluating Generative Models for Discourse Parsing The paper compares discriminative and generative language models for rhetorical structure parsing and elementary discourse unit segmentation. Ranked #420Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Systematically compares generative versus discriminative models on standard discourse parsing benchmarks like RST-DT. |
361–420 of 3,345← PreviousNext →