Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Watts If? A Benchmark for Counterfactual Reasoning About the AI Data Center Buildout
The paper introduces a benchmark to evaluate how language models perform counterfactual reasoning regarding AI data center infrastructure and siting commitments.
Ranked #481New testPreprint5/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Introduces DCBench-440 to evaluate LLMs on counterfactual reasoning and infrastructure decisions.
Probing Negation Understanding in Vision-Language Models With Object Attention
The paper analyzes how vision-language models process negation by comparing model attention mechanisms with human eye-tracking data.
Ranked #482Surprising resultPreprint5/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Evaluates and diagnoses failure modes in VLM negation comprehension.
Not X, but When: Diagnosing a Mandarin LLM Writing Tic through Contextual Appropriateness
Analyzes the overuse and contextual appropriateness of a common corrective phrasing pattern in Mandarin language model text.
Ranked #483Surprising resultPreprint5/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Evaluates LLM output appropriateness and biases in reward models and LLM judges.
MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents
Introduces a controlled Minecraft benchmark to evaluate whether embodied agents acquire persistent, transferrable skills across environment resets.
Ranked #484New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Introduces a new benchmark and methodology to audit self-improvement and capability transfer in agents.
A Better Metric Will Not Save You: What You Compare Beats How You Compare It
Analyzes representational similarity metrics and demonstrates that input category selection has a larger impact on comparisons than the choice of metric.
Ranked #485Surprising resultPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Analyzes how comparative evaluation metrics and benchmark conditions impact model rankings.
Why Heavy-Tailed Weight Spectra Predict Model Quality
Provides a probabilistic marginal likelihood derivation explaining why heavy-tailed weight spectral metrics correlate with deep network generalization quality.
Ranked #486New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
On-topic
Analyzes why heavy-tailed weight spectra theoretically predict model quality in DNNs and LLMs.
Scale, Drivers, and Limits of Representational Alignment Across Large Language Models
The paper presents two geometric methods to evaluate where and why representational structures align across different large language models.
Ranked #487New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces new methods (NW-RSA and CF-RSA) to evaluate and compare representations across language models.
SceneForesee: Learning Scene Evolution for Spatiotemporal Reasoning
The paper introduces a benchmark and framework to evaluate how multimodal models track entities and reason about future scene evolution in videos.
Ranked #488New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces SceneForesee, a benchmark for evaluating spatiotemporal reasoning and entity continuity in vision models.
Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis
This paper presents a synthetic multi-panel chart visual question answering dataset to evaluate how multimodal models interpret complex scientific figures.
Ranked #489New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces a new visual question answering benchmark for testing chart analysis capabilities.
Not All Drift Is a Mechanism: Tracing Prompt Adaptation in LLMs
The authors trace internal representations across prompt optimization techniques to show how discrete prompts, prompt tuning, and prefixes alter model processing.
Ranked #490New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Examines whether internal representation measurements reliably evaluate prompt adaptation.
Online LLM Personalization from Pairwise Preferences Across Users
The paper formulates online language model persona personalization as a dueling bandit problem using sequential pairwise user preferences.
Ranked #491New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Releases an online preference benchmark and dataset to evaluate personalization algorithms.
GENDIS: Gender-Related Discourse and Stance in Multilingual YouTube Comments from India, Kenya, and Nigeria
The paper presents GENDIS, a multilingual dataset of YouTube comments from India, Kenya, and Nigeria annotated for gender-related discourse and stance.
Ranked #492New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces a new multilingual dataset and benchmark for evaluating gender-related discourse and stance detection.
AD4EDU: Benchmarking University Lecture Audio Description across Accessibility Standards, Metrics, and Learner Preferences
This paper introduces a benchmark and rule-based metric for generating and evaluating audio descriptions in university slide lectures.
Ranked #493New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces AD4Edu-Bench and an evaluation metric for assessing audio descriptions.
Attention-Graph Curvature for the Verification of Mathematical Reasoning
This paper evaluates whether attention-graph curvature features can help verifiers detect errors in mathematical reasoning steps.
Ranked #494New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Evaluates per-step verifiers for detecting errors in complex mathematical reasoning sequences.
EHR-Bench: A Chinese Multi-Task Benchmark for Recruitment AI
This paper introduces a Chinese multi-task evaluation benchmark covering six recruitment application areas for language models.
Ranked #495New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces EHR-Bench, a multi-task benchmark and evaluation framework for recruitment AI.
Local Citation Recommendation Without Graph Signals
The paper introduces a dataset and citation recommendation system that retrieves relevant scientific papers without relying on citation graphs.
Ranked #496New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Introduces a new benchmark dataset for local citation recommendation.
How Reliable are AMR Parser Outputs? Uncertainty Estimation for AMR Parsing
Studies uncertainty estimation for abstract meaning representation parsers using top-k beam candidates and prediction rejection ratios.
Ranked #497New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Explores uncertainty estimation and metric reliability for evaluating semantic parsers.
GeoFitBench-LLM: A Benchmark for Assessing Large Language Models' Capabilities in Geospatial Data Requirements Elicitation for Geo-Analytic Tasks
Introduces a benchmark evaluating language models on eliciting geospatial data requirements and constraints from natural language requests.
Ranked #498New testPeer-reviewed4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Proposes GeoFitBench-LLM, a benchmark evaluating LLM capabilities in geospatial requirement elicitation.
Looking Inside LLMs: Small-World Connectivity as a Signature of Reasoning Performance
Analyzes attention-head activation graphs to show that small-world connectivity correlates with reasoning performance in large language models.
Ranked #499New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Investigates structural metrics that correlate with and evaluate LLM reasoning capabilities.
From Surface to Depth: Towards Cognitive Appraisal Reasoning in Multimodal Emotion Understanding
Introduces a dataset and benchmark to model multimodal emotion understanding through cognitive appraisal reasoning rather than superficial affective cues.
Ranked #500New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Introduces a new benchmark and evaluation paradigm to address shortcut learning in multimodal emotion understanding.
How Is Automated Research Evaluated? A Survey of Benchmarks and Evaluation Practices
Surveys benchmarks, metrics, and experimental practices used to evaluate automated research systems across ideation, coding, writing, and peer review.
Ranked #501New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Comprehensive survey focusing specifically on benchmarks, evaluators, and evaluation practices.
A 3D Characterization Framework for Intelligent Sequential Decision Making
Proposes a three-dimensional framework evaluating decision-making artificial intelligence methods across sequential formalisms, autonomy levels, and computational cost.
Ranked #502New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Introduces an evaluation framework to compare sequential decision-making reasoning paradigms.
Activating the Annotator: Operationalising Lived Experience in Data Annotation
Tests whether priming annotators with scenario vignettes and micro-narratives improves the operationalization of lived experience in subjective annotation.
Ranked #503New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
On-topic
Studies how annotator priming affects ground-truth labeling and evaluation metrics for hate speech.
RegExtract: A Benchmark for PFAS Regulatory Information Extraction with LLMs
The paper introduces an information extraction benchmark for extracting structured regulatory fields and source provenance from dense environmental policy documents.
Ranked #504New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Introduces RegExtract, a benchmark and evaluation framework for regulatory information extraction.
Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation
The paper benchmarks twenty-three self-supervised 3D medical vision foundation models across segmentation, classification, and regression tasks.
Ranked #505New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Presents a standardized benchmark across 23 foundation models and 14 tasks.
LongHisDoc: A Comprehensive Benchmark for Chinese Long Historical Document Understanding
This paper introduces a benchmark of expert-annotated question-answer pairs to evaluate multimodal comprehension of long historical Chinese documents.
Ranked #506New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Introduces a new expert-annotated benchmark for long document understanding.
CREATE: Creativity Evaluation of VLMs using the Visual Remote Associates Test
This paper introduces a visual associative test benchmark to evaluate the lateral reasoning and creative association capabilities of vision-language models.
Ranked #507New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces CREATE, a new benchmark to evaluate lateral reasoning and creativity in models.
Is the Platform Part of the Measurement? A Protocol and Simulation Study for Cross-Platform Equivalence of Machine-Labelled Policy Sentiment
This paper presents a psychometric framework to test whether automated sentiment classification remains equivalent across different social media platforms.
Ranked #508New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Evaluates measurement invariance and validity of machine-labelled sentiment across platforms.
Beyond the greenwash: do LLMs' ecologically sound decisions hold up under pressure?
This paper measures whether ecological alignment in large language models survives under pressure using a calibrated pretraining ladder.
Ranked #509Surprising resultPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Introduces evaluation scenarios and a calibration ladder to test behavioral alignment under pressure.
TLA-Verus: Generating and Solving Temporal Proof Obligations with LLM Agents
Uses language model agents and deterministic translation to convert TLA+ formal specifications into machine-checkable Verus proofs.
Ranked #510New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Introduces an evaluation dataset and benchmarks current models on Verus formal theorem proving.
PMO-Dock: Benchmarking Docking, Specificity, and Generalization in Molecular Optimization
The paper introduces a standardized 25-task benchmark and evaluation protocol for docking-based molecular optimization in drug design.
Ranked #511New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces a standardized benchmark and evaluation protocol for molecular optimization and docking.
APRiL: An Open-ended Benchmark for Chinese Social Awareness in Large Language Models
Presents a benchmark with open-ended tasks and rubrics to assess social awareness and response generation in Chinese.
Ranked #512New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Introduces APRiL, a new benchmark evaluating social awareness in language models.
X-RIC: An Agentic RAN-Intelligent Controller Benchmark for Enhancing Reinforcement Learning
The paper introduces an agentic reasoning controller framework and an evaluation benchmark for optimizing open radio access networks.
Ranked #513New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Introduces a domain-specific evaluation framework assessing agentic control across latency and compliance.
What Matters in Quality-Aware VLA Pretraining: A Benchmark and Empirical Study
The paper studies how demonstration quality weighting, filtering, and conditioning affect vision-language-action model pretraining and downstream performance.
Ranked #514New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces AXIS-Bench to evaluate pretraining data quality approaches for VLAs.
AMemOps: Evaluating Memory Updates in Long Audio Streams
The authors introduce a benchmark to evaluate how audio models update, retain, or reject recurring acoustic sources in long streams.
Ranked #515New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces AMemOps, a new benchmark evaluating memory update operations in audio models.
Aligning Faithfulness for Theory-Scale Autoformalization
The authors propose evaluating autoformalization faithfulness by aligning phrase-level correspondences between informal mathematics and formal code under contextual interpretations.
Ranked #516New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces FaithAlign, a benchmark to evaluate the faithfulness of autoformalization.
FASHION-RQ: Mining Hierarchical Semantic Structure for Automated Evaluation of Fashion Retrieval
Introduces FASHION-RQ, an automated framework deriving hierarchical evaluation benchmarks for fashion retrieval directly from catalog structures.
Ranked #517New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Constructs an automated benchmark and evaluation suite for fine-grained retrieval systems.
PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction
The paper introduces a benchmark to evaluate coding agents building executable physical simulations from video observations using Blender.
Ranked #518New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces a benchmark evaluating coding agents on physically verifiable 4D reconstruction.
SonicWorld: Source-Centric Latent Dynamics for Spatial Audio Reasoning
Introduces a dynamic spatial audio reasoning benchmark and an architecture tracking acoustic sources across moving indoor scenes.
Ranked #519New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces Sonic-Bench for spatial audio reasoning evaluation.
Interactive Navigation Beyond Reachability: Benchmark and Agentic Framework
Introduces a benchmark and agent framework for embodied navigation tasks requiring physical environment interactions like opening doors.
Ranked #520New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces MultINav-Bench, a new benchmark and evaluation protocol for interactive embodied navigation.
PsyMemBehav: Psychology-Informed and Memory-Grounded Two-Level Identity-to-Action Reasoning for Social-Media Behavior Simulation
The paper develops a dataset and framework to simulate realistic user social media actions using psychological profiles and retrieved interaction histories.
Ranked #521New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces PsyMemBehav-bench to benchmark and evaluate LLM behavioral simulation accuracy.
AI Discovery in Combinatorics: From Problems to Solutions and Back to Bigger Problems
Introduces a benchmark of 29 open algebraic combinatorics problems to evaluate algorithm discovery by frontier AI models.
Ranked #522New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces qtBench, a benchmark of 29 open problems testing AI systems on combinatorics.
Large language model-generated patterns for epidemiological modeling: a multi-benchmark evaluation framework
The paper evaluates whether language models can generate accurate behavioral association patterns for epidemiological modeling using external survey and agent-based benchmarks.
Ranked #523New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Proposes a multi-benchmark evaluation framework measuring the fidelity of LLM-generated behavioral distributions.
North or South? Diagnosing LLMs' Understanding of North Korean Language, Society, and Knowledge
The paper presents LENS, a benchmark evaluating language models on North Korean linguistic nuances, sociocultural perspectives, and domain knowledge.
Ranked #524New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Introduces a benchmark evaluating LLM understanding of North Korean language, society, and domain knowledge.
Knowledge transfer between simple discrete worlds
This paper examines how recurrent models generalize and transfer rule-based reasoning across discrete puzzle environments.
Ranked #525New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Provides a systematic evaluation framework testing rule generalization regimes in discrete environments.
Can You Trust Your Preference Models? Stackelberg Games for Alignment
This paper models preference model alignment as a Stackelberg game to identify comparisons where evaluators are prone to error.
Ranked #526New way to see a problemPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Examines preference model error and evaluator reliability using game-theoretic auditing.
ASIWorld: Benchmarking Autonomous Agents in a Persistent Survival Sandbox
This paper introduces a persistent survival sandbox benchmark to evaluate sustained goal execution and program synthesis in autonomous agents.
Ranked #527New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
On-topic
Presents a novel benchmark evaluating sustained agent goal execution in persistent environments.
Rarity Determines Minimax Rates of Semantic Entropy From Weak Pairwise Judgments With a Known Channel
This paper establishes minimax rates for estimating language model semantic entropy using verdicts from weak pairwise equivalence judges.
Ranked #528Surprising resultPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
On-topic
Analyzes minimax estimation rates of semantic entropy for evaluating language model answer distributions.
Definition Grounding in Theory-Level Auto-formalization
The paper proposes definition grounding to continuously evaluate and revise formal mathematical definitions generated by language model agents.
Ranked #529New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces ReuseBench, a benchmark assessing the quality and compatibility of formal mathematical definitions.
BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla
The paper introduces a 1,000-problem benchmark for constraint-based planning and decision-making in the Bangla language.
Ranked #530New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces a benchmark of 1,000 constraint-based planning problems to evaluate LLMs in Bangla.
AVC-Reward: Event-Centric Audio-Video Consistency Evaluation
The authors present AVC-Reward, an event-centric framework to evaluate temporal, narrative, and attribute consistency in generated audio-video content.
Ranked #531New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
On-topic
Proposes a new benchmark and evaluation framework for measuring multimodal audio-video consistency.
Sparse Transformer: a Controlled Testbed for Mechanistic Interpretability
The paper introduces a sparse transformer testbed with interpretable neurons to evaluate mechanistic interpretability methods.
Ranked #532New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces a controlled sparse transformer testbed to evaluate mechanistic interpretability methods.
Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding
This paper introduces a task and benchmark for tracking candidate sets of referent objects across ambiguous interactive dialogue turns.
Ranked #533New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces CandVG, a benchmark evaluating model performance under dialogue ambiguity.
KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?
The paper introduces a benchmark to evaluate how well language models recognize, infer, and coin newly emerging Korean terms.
Ranked #534New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces KoAGE, a cutoff-aware evaluation benchmark testing neologism acquisition and generation in LLMs.
JockeyBench: Evaluating LLM Agents on Horse-Racing Decision-Making
The paper introduces a horse-racing decision benchmark to evaluate whether agents can extract profitable signals from noisy historical data.
Ranked #535New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces JockeyBench, a new benchmark evaluating LLM agents on noisy sequential decision-making.
Beyond Equation Search: Conjecture-Guided Discovery with SCOPE and ClosureBench
Introduces a multi-agent framework where simulated scientists formulate, test, and revise scientific conjectures alongside mathematical equations.
Ranked #536New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Presents ClosureBench, a 60-task benchmark assessing conjecture and closure discovery.
From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech
This paper introduces a multi-hop reasoning benchmark to evaluate fine-grained, explainable hate speech analysis in Persian.
Ranked #537New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces a multi-hop reasoning benchmark for fine-grained, explainable Persian hate speech analysis.
Beyond Benchmark Accuracy: A Diagnostic Test for LLM Chemical Prediction
The paper proposes a diagnostic test hiding target identity to evaluate structure-property chemical reasoning in language models.
Ranked #538New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Presents a diagnostic evaluation framework to benchmark LLM chemical prediction without target identity leakage.
Counterfactual Gate-Support Decomposition: Separating Selection from Redistribution in Training-Data Filtering
The paper proposes an experimental design that separates example selection from mass redistribution to analyze the effects of training-data quality filtering.
Ranked #539New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces a counterfactual decomposition framework to rigorously evaluate data filtering.
The Sum of All Summaries: PROPALIGN for Graded Proposition Salience Evaluation
The paper proposes a multiple-summary metric and dataset to evaluate graded proposition salience across diverse text genres.
Ranked #540New testPreprint4/10 suggested
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
On-topic
Introduces PROPALIGN and a benchmark dataset to evaluate proposition salience.
481–540 of 3,345← PreviousNext →