Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Enhancing Legal Reasoning in Pre-trained Language Models via Knowledge Graph-Guided Multi-Task Pre-training
The paper proposes multi-task pre-training guided by knowledge graphs to improve zero-shot legal reasoning in language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents pre-training objectives for legal reasoning rather than an evaluation framework.
Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models
The paper studies language model sensitivity to discourse particles such as 'just' and 'only' in natural conversations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes linguistic sensitivity to specific words rather than standard LLM evaluation frameworks.
REFLECT: Role-Aware Detection of Sentiment, Emotion, Politeness, and Formality
The paper introduces a transformer architecture incorporating semantic role labeling into attention mechanisms to detect sentiment, emotion, politeness, and formality.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a transformer architecture for classification rather than a benchmark or evaluation method.
Error Rate is Not Enough: Costs of Augmentation in Low-Resource ASR
The paper analyzes phoneme-level error patterns from audio and text data augmentation techniques in low-resource automatic speech recognition.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes ASR augmentation error metrics rather than general LLM evaluation benchmarks.
Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion
The paper proposes a training-free query expansion method that filters hallucinated terms using corpus-conditioned cross-context reproducibility.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a query expansion filtering method rather than general benchmark evaluation methodology.
Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection
The paper studies policy learning and answer-selection mechanisms to help language models decide when to abstain on factual questions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates abstention policies rather than proposing new general benchmark suites or evaluation methodologies.
OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation
The paper presents an automatic pronunciation assessment method using Whisper cross-attention to predict word- and utterance-level scores without forced alignment.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an automated pronunciation scoring system rather than LLM benchmarking.
Structural Automata for Neural Semantic Parsing
The paper proposes accepting-path decoding using structural automata to enforce valid prefix completions within length limits for neural semantic parsing.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a decoding mechanism rather than an LLM evaluation benchmark.
RSI-Anything: Unlocking Recursive Self-Improvement with World Models
The paper introduces a domain-general framework using predictive world models to guide action selection and policy improvement in recursive self-improvement settings.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a self-improvement method rather than an evaluation framework.
Epistemic Disturbance in the Graph Model for Conflict Resolution: State-Preserving Actions, Four-Valued Assessments, and the Distinction between Capability and Intention
The paper extends the Graph Model for Conflict Resolution by incorporating epistemic states and state-preserving actions into its decision-making framework.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Addresses formal conflict graph modeling, not LLM evaluation benchmarks.
Can Jev be Your Q or Policy in Reinforcement Learning?
Studies how the non-generative decision model Jev can serve as a prior or policy component within reinforcement learning frameworks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an RL algorithmic integration rather than an evaluation benchmark.
Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Model
Introduces a unified benchmark and pretrained encoder-decoder model for evaluating enzymatic reaction prediction and enzyme commission classifications.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a biochemical reaction benchmark rather than an LLM evaluation framework.
Intervention anchors and scientific verification in synthetic vascular predictive representations
Presents a mathematical audit on how intervention anchors and coordinate transport affect stability in synthetic vascular predictive representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on synthetic biomedical representation math rather than LLM benchmarks.
DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents
Introduces a step-level memory reuse framework using transition graphs to adapt relevant prior mobile graphical interface execution trajectories.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an agent framework rather than an LLM evaluation benchmark.
Internalizer: Portable Context-to-Parameter Mapping for Very Large Language Models
Presents a hypernetwork that maps document contexts directly into low-rank adapter weights for large language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a parameter mapping technique rather than an evaluation benchmark.
MAP4CS: A Multi-dimensional Data Pruning Framework for Efficient Code Retriever Fine-tuning
Presents a multi-dimensional data pruning framework that filters code repositories by syntax, diversity, and representation for efficient retriever fine-tuning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a data pruning method rather than an evaluation benchmark.
MemTrial: Learning When to Trust Memory in LLM Portfolio Agents
Presents a portfolio management agent that uses fractional factorial counterfactual evaluation and Banzhaf values to isolate memory utility from market movements.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Designs an agent decision mechanism rather than an LLM evaluation benchmark.
Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives
Introduces a multivariate time series foundation model pretrained using synthetic temporal and relational pattern primitives for zero-shot forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a forecasting foundation model rather than an LLM evaluation benchmark.
Onboard Marine Anomaly Detection on $Φ$sat-2: From Simulation-Based Development to In-Orbit Demonstration
Describes an onboard satellite pipeline combining segmentation and self-supervised feature encoding for real-time marine anomaly detection.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Covers deployment of an anomaly detection model rather than an evaluation benchmark.
Uncovering and Fixing Collider Bias in Bayesian PINNs
Analyzes collider bias in Bayesian physics-informed neural networks and introduces a hierarchical generative chain model to resolve parameter estimation drift.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Studies parameter estimation bias in PINNs rather than LLM benchmarks.
Scalable AI Uncertainty Quantification via Generalized Laplace Active Subspaces
Develops a low-rank generalized Laplace approximation over active curvature directions for scalable neural network uncertainty quantification.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a mathematical method for parameter uncertainty rather than evaluating LLM capabilities.
DEX: Digit-Level Early Exit for Energy-Efficient MSDF Neural Network Inference
Designs a most-significant-digit-first neural network accelerator supporting early exits and digit-level pruning for energy-efficient medical image segmentation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents hardware acceleration mechanisms rather than model evaluation methods.
Where Draft Trees Lose Target Mass: Exit-Guided Speculative Decoding
Introduces an exact level-parallel tree verification procedure for speculative decoding derived from a canonical exit law of target-model probabilities.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an inference speedup method, not an evaluation framework or benchmark.
Narrow and Deep: An Ontology Tower as the Knowledge of an LLM Agent for an Industrial Equipment System
Proposes a narrow-and-deep ontology tower to structure equipment knowledge for language model agents operating industrial air-handling systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Applies models to equipment tasks rather than developing general LLM evaluation benchmarks.
RouterInterp: Understanding Superposed Specialisation in Mixture of Experts Routing
Proposes an interpretability framework using sparse autoencoders to explain mixture of experts routing based on superposed fine-grained features.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Provides a model interpretability technique rather than an evaluation benchmark.
AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance
Presents a system combining representation learning and music alignment to generate editable aesthetic stage lighting cues for live performances.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a lighting synthesis system rather than general LLM evaluation benchmarks.
Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks
Proposes an external memory framework allowing frozen language model agents to learn and iteratively refine natural-language world models compiled into executable code.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces an agent self-improvement architecture rather than a benchmarking framework.
From Pixels to Structure: Lightweight Vision-Language Models for Document OCR and Structured JSON Extraction
Evaluates eight lightweight open-source vision-language models on optical character recognition and schema-compliant JSON extraction across heritage document collections.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Comparative study on document OCR without introducing a general LLM benchmark methodology.
From Suppression to Repair: Mitigating Object Hallucination in Large Vision-Language Models via Localized Distribution Alignment
Introduces a training-free inference method using Gaussian optimal transport to reduce object hallucination in vision-language models without suppressing valid representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a hallucination repair algorithm rather than a new evaluation suite or benchmark.
Probability-Signature Dynamics: Unpacking Modular Addition Learning Within Two-Layer Networks
Analyzes modular addition learning in two-layer neural networks using probability signatures to explain how gradient training selects Fourier-structured representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Theoretical analysis of modular arithmetic training rather than LLM benchmarking.
GRPODropout: Less is More for Online Reinforcement Learning Rollouts
Presents a rollout selection strategy that drops high-probability positive-advantage trajectories to prevent entropy collapse during language model reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an algorithmic training intervention rather than an evaluation framework or benchmark.
Trajectory-Guided Fault Localization for Agent Skill Evolution
Proposes a method linking execution traces to specific skill segments to guide automated revision of software engineering agent skills.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a skill refinement method rather than a general LLM evaluation benchmark study.
LEVER: Adaptive Cost-Aware Proof Search Over AND/OR Graphs
Introduces an AND/OR graph proof search algorithm optimizing customizable objectives like length and compute cost during automated formal theorem proving.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Applies a theorem proving algorithm on existing benchmarks rather than proposing evaluation methods.
Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System
Surveys and taxonomizes recurring architectural patterns across language-model-integrated software applications, ranging from chatbots to autonomous agent systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Taxonomy survey of application architectures, not a benchmark or evaluation methodology paper.
Beyond Visual Enhancement: Adaptive Multi-Context Steering to Mitigate LVLM Hallucinations
Proposes an adaptive multi-source steering decoding method to mitigate hallucinations in vision-language models by balancing visual and textual context contributions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an inference-time steering method rather than introducing LLM evaluation benchmarks or protocols.
Neural Decoding as Cognitive Inference
Formulates neural decoding as Bayesian cognitive inference to extract stable meta-neural semantic representations across varying neural recording modalities.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents biological neural decoding experiments, not benchmarks or evaluations for large language models.
EliteTable: Self-Improving Program Search for Executable Control Policies
Presents a program-search method using a curated elite solution table to guide language models in synthesizing executable control policies.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates a search algorithm on standard control tasks rather than contributing new LLM benchmark methodology.
Stochastic Grouping Conformal Prediction for Effective Subgroup Reliability
Proposes a conformal prediction framework that learns stochastic groupings to improve subgroup coverage reliability without inflating overall prediction sets.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a statistical uncertainty quantification method, not an LLM benchmark or evaluation protocol.
MetaOPD: Meta-Learned Token Weighting for On-Policy Distillation
Presents a bilevel optimization framework for on-policy distillation that meta-learns dynamic token weights based on student validation loss.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an on-policy distillation method rather than a framework for evaluating LLMs.
Neural Network Verification for Deep Joint Source-Channel Coding
Presents a bound-propagation verification framework to bound worst-case reconstruction errors for deep joint source-channel coding decoders under noise.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops verification methods for wireless neural decoders rather than LLM evaluation.
Agentic-TTT: Training test-time policy for test-time training
Proposes a policy mechanism enabling language models to decide when, how, and which test-time training procedures to execute.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an algorithmic framework for test-time adaptation rather than LLM evaluation methodologies.
An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation
Uses Monte Carlo tree search and structural experience distillation to identify interpretable symbolic expressions for partial differential equation solutions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Addresses symbolic scientific discovery algorithms rather than LLM evaluation benchmarks.
The Polytopal Neural Network
Introduces a neural network architecture enforcing layer-wise polytopal constraints to improve latent representation interpretability without degrading task performance.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Addresses model interpretability methods rather than LLM benchmarking or evaluation frameworks.
REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models
Proposes a rolling-denoising framework for vision-language-action models to improve robot control reactivity without sacrificing long-horizon execution consistency.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a control framework rather than benchmark evaluation of language models.
Complexity of Grounded Semantics and Preferred Semantics in Finitary Argumentation Frameworks
Analyzes the computational complexity of grounded and preferred semantics decision problems within computably finitary abstract argumentation frameworks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Investigates formal computational complexity rather than empirical LLM evaluation methods.
PulseBound: Future-Beat State Forecasting Under an Explicit Information Boundary
Develops a representation learning approach for photoplethysmography data that enforces strict causal information boundaries during future-beat forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on physiological time-series forecasting, not language model evaluation or benchmarks.
Humanoid World Action Model With Joint State--Action Generation
Introduces a world action model for humanoid robots that jointly models robot internal states and scene evolution to close the execution gap.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a world action model architecture rather than LLM benchmarking or evaluation frameworks.
Traceable World State: A Provenance-Aware State Representation and Deterministic Replay Framework for Robotic Systems
Introduces an immutable, provenance-aware state representation framework with deterministic replay and audit logging for robotic systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a robotics runtime architecture rather than an LLM evaluation benchmark.
MPGE: A Multi-Perspective Graph Explainer for Molecular Classification Explanation
Presents an explainer for molecular graph neural networks combining factual, counterfactual, and exemplar graph perturbations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Addresses graph explainability techniques rather than language model evaluation or benchmarks.
When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation
Proposes a training method to adaptively skip turn-by-turn agent reasoning when previous thoughts remain sufficient for future actions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a training method for adaptive reasoning rather than evaluation benchmarks or testing methodologies.
MAST: Motif-Augmented Diffusion with Search Tree for Spectroscopic Molecular Structure Elucidation
Combines motif priors with search-tree diffusion to generate 2D and 3D molecular structures from spectroscopic data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Applies a method to a chemical benchmark; does not focus on LLM evaluation or benchmark design.
Is Memorization Context-Sensitive? Prefix-Based Extraction Beyond Isolated Prefixes
Analyzes training data extraction risks in language models when prompts include contextual conditioning such as retrieved documents.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes training data extraction phenomena rather than proposing evaluation benchmarks.
EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolution
Proposes a self-evolving agent that allocates evaluation resources dynamically across candidate programs during iterative code evolution.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces an optimization agent rather than general LLM evaluation benchmarks or assessment techniques.
Recompose and Refine Latent Reasoning Flows for Vision-Language-Action Models
Introduces a framework that dynamically retrieves and recomposes prior latent reasoning steps to guide vision-language-action robot policies.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops a robot policy architecture rather than LLM evaluation or benchmarking methods.
VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling
Transfers editing capabilities from image pairs to video diffusion models using in-context visual demonstrations across decomposed sub-tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a video editing diffusion framework rather than an evaluation benchmark.
A Geometric Approach to Soft Actor-Critic with Zonotopes for Locomotion Learning
Applies zonotope geometry to adaptively scale critic pessimism and disagreement handling in soft actor-critic locomotion policies.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on deep RL optimization techniques rather than LLM evaluation or benchmark design.
Universal Textual Teaching for LLMs
Presents a parameter-free distillation framework transferring knowledge between language models via an iteratively updated natural language guide.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a knowledge transfer framework rather than studying LLM evaluation or benchmark integrity.
Using Weisfeiler-Leman Features for Algorithm Selection in Constraint Optimisation
Applies Weisfeiler-Leman graph kernel features to improve automated algorithm selection for constraint optimization problems without training GNNs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on algorithm selection for constraint programming rather than language model evaluation.
Use and Disuse: Intent-Structured Experience Consolidation for Memory and Learning in LLM Agents
Introduces a hierarchical memory architecture that consolidates nested agent task intents into reusable knowledge across long horizons.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on an agent memory architecture rather than LLM benchmarking or evaluation frameworks.
LVS: Local View Synthesis from Relative Camera Pose by Reusing Previous Views
Synthesizes novel views by reusing nearby rendered RGB-D images and applying pose-guided warping with residual refinement.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a graphics rendering framework rather than an evaluation benchmark for models.
3,121–3,180 of 3,345← PreviousNext →