Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Enhancing Legal Reasoning in Pre-trained Language Models via Knowledge Graph-Guided Multi-Task Pre-training The paper proposes multi-task pre-training guided by knowledge graphs to improve zero-shot legal reasoning in language models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents pre-training objectives for legal reasoning rather than an evaluation framework. | |
| Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models The paper studies language model sensitivity to discourse particles such as 'just' and 'only' in natural conversations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes linguistic sensitivity to specific words rather than standard LLM evaluation frameworks. | |
| REFLECT: Role-Aware Detection of Sentiment, Emotion, Politeness, and Formality The paper introduces a transformer architecture incorporating semantic role labeling into attention mechanisms to detect sentiment, emotion, politeness, and formality. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a transformer architecture for classification rather than a benchmark or evaluation method. | |
| Error Rate is Not Enough: Costs of Augmentation in Low-Resource ASR The paper analyzes phoneme-level error patterns from audio and text data augmentation techniques in low-resource automatic speech recognition. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes ASR augmentation error metrics rather than general LLM evaluation benchmarks. | |
| Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion The paper proposes a training-free query expansion method that filters hallucinated terms using corpus-conditioned cross-context reproducibility. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a query expansion filtering method rather than general benchmark evaluation methodology. | |
| Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection The paper studies policy learning and answer-selection mechanisms to help language models decide when to abstain on factual questions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates abstention policies rather than proposing new general benchmark suites or evaluation methodologies. | |
| OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation The paper presents an automatic pronunciation assessment method using Whisper cross-attention to predict word- and utterance-level scores without forced alignment. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an automated pronunciation scoring system rather than LLM benchmarking. | |
| Structural Automata for Neural Semantic Parsing The paper proposes accepting-path decoding using structural automata to enforce valid prefix completions within length limits for neural semantic parsing. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a decoding mechanism rather than an LLM evaluation benchmark. | |
| RSI-Anything: Unlocking Recursive Self-Improvement with World Models The paper introduces a domain-general framework using predictive world models to guide action selection and policy improvement in recursive self-improvement settings. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a self-improvement method rather than an evaluation framework. | |
| Epistemic Disturbance in the Graph Model for Conflict Resolution: State-Preserving Actions, Four-Valued Assessments, and the Distinction between Capability and Intention The paper extends the Graph Model for Conflict Resolution by incorporating epistemic states and state-preserving actions into its decision-making framework. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Addresses formal conflict graph modeling, not LLM evaluation benchmarks. | |
| Can Jev be Your Q or Policy in Reinforcement Learning? Studies how the non-generative decision model Jev can serve as a prior or policy component within reinforcement learning frameworks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an RL algorithmic integration rather than an evaluation benchmark. | |
| Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Model Introduces a unified benchmark and pretrained encoder-decoder model for evaluating enzymatic reaction prediction and enzyme commission classifications. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a biochemical reaction benchmark rather than an LLM evaluation framework. | |
| Intervention anchors and scientific verification in synthetic vascular predictive representations Presents a mathematical audit on how intervention anchors and coordinate transport affect stability in synthetic vascular predictive representations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on synthetic biomedical representation math rather than LLM benchmarks. | |
| DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents Introduces a step-level memory reuse framework using transition graphs to adapt relevant prior mobile graphical interface execution trajectories. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an agent framework rather than an LLM evaluation benchmark. | |
| Internalizer: Portable Context-to-Parameter Mapping for Very Large Language Models Presents a hypernetwork that maps document contexts directly into low-rank adapter weights for large language models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a parameter mapping technique rather than an evaluation benchmark. | |
| MAP4CS: A Multi-dimensional Data Pruning Framework for Efficient Code Retriever Fine-tuning Presents a multi-dimensional data pruning framework that filters code repositories by syntax, diversity, and representation for efficient retriever fine-tuning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a data pruning method rather than an evaluation benchmark. | |
| MemTrial: Learning When to Trust Memory in LLM Portfolio Agents Presents a portfolio management agent that uses fractional factorial counterfactual evaluation and Banzhaf values to isolate memory utility from market movements. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Designs an agent decision mechanism rather than an LLM evaluation benchmark. | |
| Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives Introduces a multivariate time series foundation model pretrained using synthetic temporal and relational pattern primitives for zero-shot forecasting. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a forecasting foundation model rather than an LLM evaluation benchmark. | |
| Onboard Marine Anomaly Detection on $Φ$sat-2: From Simulation-Based Development to In-Orbit Demonstration Describes an onboard satellite pipeline combining segmentation and self-supervised feature encoding for real-time marine anomaly detection. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Covers deployment of an anomaly detection model rather than an evaluation benchmark. | |
| Uncovering and Fixing Collider Bias in Bayesian PINNs Analyzes collider bias in Bayesian physics-informed neural networks and introduces a hierarchical generative chain model to resolve parameter estimation drift. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Studies parameter estimation bias in PINNs rather than LLM benchmarks. | |
| Scalable AI Uncertainty Quantification via Generalized Laplace Active Subspaces Develops a low-rank generalized Laplace approximation over active curvature directions for scalable neural network uncertainty quantification. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a mathematical method for parameter uncertainty rather than evaluating LLM capabilities. | |
| DEX: Digit-Level Early Exit for Energy-Efficient MSDF Neural Network Inference Designs a most-significant-digit-first neural network accelerator supporting early exits and digit-level pruning for energy-efficient medical image segmentation. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents hardware acceleration mechanisms rather than model evaluation methods. | |
| Where Draft Trees Lose Target Mass: Exit-Guided Speculative Decoding Introduces an exact level-parallel tree verification procedure for speculative decoding derived from a canonical exit law of target-model probabilities. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an inference speedup method, not an evaluation framework or benchmark. | |
| Narrow and Deep: An Ontology Tower as the Knowledge of an LLM Agent for an Industrial Equipment System Proposes a narrow-and-deep ontology tower to structure equipment knowledge for language model agents operating industrial air-handling systems. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Applies models to equipment tasks rather than developing general LLM evaluation benchmarks. | |
| RouterInterp: Understanding Superposed Specialisation in Mixture of Experts Routing Proposes an interpretability framework using sparse autoencoders to explain mixture of experts routing based on superposed fine-grained features. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Provides a model interpretability technique rather than an evaluation benchmark. | |
| AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance Presents a system combining representation learning and music alignment to generate editable aesthetic stage lighting cues for live performances. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a lighting synthesis system rather than general LLM evaluation benchmarks. | |
| Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks Proposes an external memory framework allowing frozen language model agents to learn and iteratively refine natural-language world models compiled into executable code. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces an agent self-improvement architecture rather than a benchmarking framework. | |
| From Pixels to Structure: Lightweight Vision-Language Models for Document OCR and Structured JSON Extraction Evaluates eight lightweight open-source vision-language models on optical character recognition and schema-compliant JSON extraction across heritage document collections. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Comparative study on document OCR without introducing a general LLM benchmark methodology. | |
| From Suppression to Repair: Mitigating Object Hallucination in Large Vision-Language Models via Localized Distribution Alignment Introduces a training-free inference method using Gaussian optimal transport to reduce object hallucination in vision-language models without suppressing valid representations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a hallucination repair algorithm rather than a new evaluation suite or benchmark. | |
| Probability-Signature Dynamics: Unpacking Modular Addition Learning Within Two-Layer Networks Analyzes modular addition learning in two-layer neural networks using probability signatures to explain how gradient training selects Fourier-structured representations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Theoretical analysis of modular arithmetic training rather than LLM benchmarking. | |
| GRPODropout: Less is More for Online Reinforcement Learning Rollouts Presents a rollout selection strategy that drops high-probability positive-advantage trajectories to prevent entropy collapse during language model reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an algorithmic training intervention rather than an evaluation framework or benchmark. | |
| Trajectory-Guided Fault Localization for Agent Skill Evolution Proposes a method linking execution traces to specific skill segments to guide automated revision of software engineering agent skills. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a skill refinement method rather than a general LLM evaluation benchmark study. | |
| LEVER: Adaptive Cost-Aware Proof Search Over AND/OR Graphs Introduces an AND/OR graph proof search algorithm optimizing customizable objectives like length and compute cost during automated formal theorem proving. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Applies a theorem proving algorithm on existing benchmarks rather than proposing evaluation methods. | |
| Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System Surveys and taxonomizes recurring architectural patterns across language-model-integrated software applications, ranging from chatbots to autonomous agent systems. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Taxonomy survey of application architectures, not a benchmark or evaluation methodology paper. | |
| Beyond Visual Enhancement: Adaptive Multi-Context Steering to Mitigate LVLM Hallucinations Proposes an adaptive multi-source steering decoding method to mitigate hallucinations in vision-language models by balancing visual and textual context contributions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an inference-time steering method rather than introducing LLM evaluation benchmarks or protocols. | |
| Neural Decoding as Cognitive Inference Formulates neural decoding as Bayesian cognitive inference to extract stable meta-neural semantic representations across varying neural recording modalities. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents biological neural decoding experiments, not benchmarks or evaluations for large language models. | |
| EliteTable: Self-Improving Program Search for Executable Control Policies Presents a program-search method using a curated elite solution table to guide language models in synthesizing executable control policies. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates a search algorithm on standard control tasks rather than contributing new LLM benchmark methodology. | |
| Stochastic Grouping Conformal Prediction for Effective Subgroup Reliability Proposes a conformal prediction framework that learns stochastic groupings to improve subgroup coverage reliability without inflating overall prediction sets. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a statistical uncertainty quantification method, not an LLM benchmark or evaluation protocol. | |
| MetaOPD: Meta-Learned Token Weighting for On-Policy Distillation Presents a bilevel optimization framework for on-policy distillation that meta-learns dynamic token weights based on student validation loss. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an on-policy distillation method rather than a framework for evaluating LLMs. | |
| Neural Network Verification for Deep Joint Source-Channel Coding Presents a bound-propagation verification framework to bound worst-case reconstruction errors for deep joint source-channel coding decoders under noise. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops verification methods for wireless neural decoders rather than LLM evaluation. | |
| Agentic-TTT: Training test-time policy for test-time training Proposes a policy mechanism enabling language models to decide when, how, and which test-time training procedures to execute. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an algorithmic framework for test-time adaptation rather than LLM evaluation methodologies. | |
| An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation Uses Monte Carlo tree search and structural experience distillation to identify interpretable symbolic expressions for partial differential equation solutions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Addresses symbolic scientific discovery algorithms rather than LLM evaluation benchmarks. | |
| The Polytopal Neural Network Introduces a neural network architecture enforcing layer-wise polytopal constraints to improve latent representation interpretability without degrading task performance. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Addresses model interpretability methods rather than LLM benchmarking or evaluation frameworks. | |
| REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models Proposes a rolling-denoising framework for vision-language-action models to improve robot control reactivity without sacrificing long-horizon execution consistency. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a control framework rather than benchmark evaluation of language models. | |
| Complexity of Grounded Semantics and Preferred Semantics in Finitary Argumentation Frameworks Analyzes the computational complexity of grounded and preferred semantics decision problems within computably finitary abstract argumentation frameworks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Investigates formal computational complexity rather than empirical LLM evaluation methods. | |
| PulseBound: Future-Beat State Forecasting Under an Explicit Information Boundary Develops a representation learning approach for photoplethysmography data that enforces strict causal information boundaries during future-beat forecasting. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on physiological time-series forecasting, not language model evaluation or benchmarks. | |
| Humanoid World Action Model With Joint State--Action Generation Introduces a world action model for humanoid robots that jointly models robot internal states and scene evolution to close the execution gap. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a world action model architecture rather than LLM benchmarking or evaluation frameworks. | |
| Traceable World State: A Provenance-Aware State Representation and Deterministic Replay Framework for Robotic Systems Introduces an immutable, provenance-aware state representation framework with deterministic replay and audit logging for robotic systems. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a robotics runtime architecture rather than an LLM evaluation benchmark. | |
| MPGE: A Multi-Perspective Graph Explainer for Molecular Classification Explanation Presents an explainer for molecular graph neural networks combining factual, counterfactual, and exemplar graph perturbations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Addresses graph explainability techniques rather than language model evaluation or benchmarks. | |
| When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation Proposes a training method to adaptively skip turn-by-turn agent reasoning when previous thoughts remain sufficient for future actions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a training method for adaptive reasoning rather than evaluation benchmarks or testing methodologies. | |
| MAST: Motif-Augmented Diffusion with Search Tree for Spectroscopic Molecular Structure Elucidation Combines motif priors with search-tree diffusion to generate 2D and 3D molecular structures from spectroscopic data. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Applies a method to a chemical benchmark; does not focus on LLM evaluation or benchmark design. | |
| Is Memorization Context-Sensitive? Prefix-Based Extraction Beyond Isolated Prefixes Analyzes training data extraction risks in language models when prompts include contextual conditioning such as retrieved documents. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes training data extraction phenomena rather than proposing evaluation benchmarks. | |
| EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolution Proposes a self-evolving agent that allocates evaluation resources dynamically across candidate programs during iterative code evolution. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces an optimization agent rather than general LLM evaluation benchmarks or assessment techniques. | |
| Recompose and Refine Latent Reasoning Flows for Vision-Language-Action Models Introduces a framework that dynamically retrieves and recomposes prior latent reasoning steps to guide vision-language-action robot policies. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops a robot policy architecture rather than LLM evaluation or benchmarking methods. | |
| VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling Transfers editing capabilities from image pairs to video diffusion models using in-context visual demonstrations across decomposed sub-tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a video editing diffusion framework rather than an evaluation benchmark. | |
| A Geometric Approach to Soft Actor-Critic with Zonotopes for Locomotion Learning Applies zonotope geometry to adaptively scale critic pessimism and disagreement handling in soft actor-critic locomotion policies. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on deep RL optimization techniques rather than LLM evaluation or benchmark design. | |
| Universal Textual Teaching for LLMs Presents a parameter-free distillation framework transferring knowledge between language models via an iteratively updated natural language guide. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a knowledge transfer framework rather than studying LLM evaluation or benchmark integrity. | |
| Using Weisfeiler-Leman Features for Algorithm Selection in Constraint Optimisation Applies Weisfeiler-Leman graph kernel features to improve automated algorithm selection for constraint optimization problems without training GNNs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on algorithm selection for constraint programming rather than language model evaluation. | |
| Use and Disuse: Intent-Structured Experience Consolidation for Memory and Learning in LLM Agents Introduces a hierarchical memory architecture that consolidates nested agent task intents into reusable knowledge across long horizons. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on an agent memory architecture rather than LLM benchmarking or evaluation frameworks. | |
| LVS: Local View Synthesis from Relative Camera Pose by Reusing Previous Views Synthesizes novel views by reusing nearby rendered RGB-D images and applying pose-guided warping with residual refinement. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a graphics rendering framework rather than an evaluation benchmark for models. |
3,121–3,180 of 3,345← PreviousNext →