Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Functional Subnetwork Localization for Efficient Continual Learning in Large Language Models
Introduces an optimization framework that localizes functional subnetworks in language models to enable continual learning without catastrophic forgetting.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a continual learning framework, not an evaluation benchmark.
Agent Status Protocol (ASP): A Lightweight Specification for State Reporting in Multi-Agent Systems
Proposes a lightweight protocol for AI agents to report runtime status and liveness to central servers and monitoring dashboards.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Defines an operational specification, not a testing benchmark.
Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond
Reviews and analyzes reinforcement learning methods used to guide and improve diffusion models across vision, language, and robotics.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Reviews RL-driven diffusion methods rather than evaluating LLM benchmarks.
When Is Muon Optimal? Radial Fragility and Minimax Geometry
The paper investigates the mathematical conditions under which the Muon optimizer's polar update acts as an optimal step.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Theoretical math and optimization paper, not an evaluation benchmark.
Uncertainty Quantification in Pairwise Difference Learning for Classification
The authors formulate classification and uncertainty quantification methods for pairwise difference learning frameworks.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies classification uncertainty, not LLM evaluation or benchmarks.
BiShield-TEE: On the (In-)Security of Unilateral Weight Obfuscation in On-Device TEE-Shielded LLM Partition
The paper demonstrates vulnerabilities in unilateral weight obfuscation schemes used for on-device secure language model inference.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on security vulnerabilities, not model evaluation benchmarks.
Independent Data-Integrity Verification for LLM-Driven Functional Coverage Closure in Hardware Design
The authors present an agent loop that closes functional test coverage in hardware design using independent simulation scoreboards.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Describes a specific agent workflow rather than general evaluation methodology.
Learning to Search for Executable Patternmaking from Certified Programs
The paper proposes a search framework to recover executable editing programs between before-and-after sewing pattern pairs.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a search framework, not a general evaluation benchmark.
AVALON: Zero-Shot Indoor Navigation with Human-Seeded Topological Memory
The authors propose an indoor navigation framework that uses user-provided floor plans and topological memory without prior robot site maps.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Presents a robotics navigation method, not an LLM benchmark.
LOADBench: A Large Open Analog Dataset and Benchmark for Machine Learning in IC Design
The paper introduces an open-source dataset and standardized benchmark suite for machine learning methods in analog integrated circuit design.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on analog IC design metrics, not LLM evaluation.
LoopAhead: Speculating Ahead for Faster Decoding in Looped Language Models
The paper introduces a speculative decoding framework that uses early recurrent states to draft tokens in looped transformers.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes an inference speedup method, not an evaluation framework.
Decoding What iOS Location Services Send to Apple: An LLM Is an Unreliable Analyst but a Useful Toolmaker
The study evaluates using language models to directly reconstruct mobile network schemas versus generating validation code tools.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies protocol reverse-engineering accuracy, not general LLM benchmarks.
Learning Intrinsic Dynamics in Latent World Models
The paper studies whether predicting actions from consecutive latent states helps world models retain essential environmental dynamics.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies latent representation dynamics, not LLM benchmarking frameworks.
Qwen-Audio-Jev: A Unified Interface for Audio Decisions
The authors introduce an audio model with a non-autoregressive decision head for selection, judgment, and scoring tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on an audio model architecture, not benchmark methodology.
Efficient Pairwise Difference Learning: A Comparative Study of Encoding Strategies and Training Pair Selection
The paper evaluates feature encoders and pair selection strategies for pairwise difference learning in low-data classification regimes.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies classical classification encoders, not LLM evaluation benchmarks.
The Self-Improvement Problem
The paper formalizes the theoretical limits of automated gates evaluating self-improvement updates in autonomous agent code.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on theoretical computability rather than empirical benchmarking.
Router Drift Control: Mitigating Off-Policy Degradation in Mixture-of-Experts Reinforcement Learning
The paper proposes filtering high-drift responses to mitigate off-policy degradation in mixture-of-experts reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes an RL training algorithm rather than LLM benchmarking.
Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures
The paper uses human interventions to localize and steer computations behind agent failure to decide between acting and clarifying.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on mechanistic interpretability rather than benchmark development.
Encoded but Exposed: Language Embeddings can Reveal More Than They Should in Recommender Systems
The authors evaluate how easily item identities and user profiles can be recovered from language embeddings in recommender systems.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies privacy leakage rather than general LLM evaluation benchmarks.
FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning
The authors introduce a Fisher-informed adapter merging method to maintain retained task performance during federated language model unlearning.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes an unlearning algorithm rather than general benchmark evaluation.
In-Context Preference-Conditioned Pareto Set Learning from Limited Offline Data
Introduces an in-context learning approach to map specified user preferences directly to Pareto-optimal solutions using offline data.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Deals with hypernetwork optimization methods, not LLM evaluation frameworks.
Reliable Knowledge Acquisition for Continual Learning Agents
Proposes a structured knowledge admission and verification system to prevent continual learning agents from storing harmful past experience entries.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a knowledge acquisition system rather than LLM evaluation methodology.
The Delegation Dilemma: Economies of Scale, Accountability, and Polycentric Governance
Models repeated games with endogenous delegation to analyze trade-offs between economies of scale and institutional accountability.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on multi-agent governance dynamics, not LLM benchmark evaluation.
Harmful Partial Interventions and Benign Leakage in Concept-based Models
Investigates how partial interventions in concept-based models can unexpectedly reduce downstream task performance due to information leakage.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies concept intervention harm rather than LLM benchmarking methods.
DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents
Develops a domain harness and policy learning pipeline to improve language model agent execution in computer-aided design environments.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a CAD agent framework, not a general LLM benchmark.
CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge
Introduces a two-stage coarse-to-fine speech separation architecture leveraging visual streams to isolate target speaker audio in noisy environments.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Speech processing model, not an LLM evaluation benchmark.
DINO-FIL: Multi-Layer Transformer Fusion for Generative Inpainting Forgery Localization
Combines multi-layer vision transformer representations with a fusion decoder to localize pixel-level generative image inpainting manipulations.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Image forensic detection model, not an LLM benchmark.
RSIFlow: Adaptive Self-Improvement Workflows with an Evolving Meta-Agent
Develops a recursive self-improvement framework where an evolving meta-agent adapts agent workflows based on execution trajectories and feedback.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on agent self-improvement architecture rather than LLM benchmarking.
Cross-Embodiment Causal Transfer from Human Videos to Robot Manipulation
Introduces a causal-beam transfer framework that extracts relevant subtask representations from human videos to guide robotic manipulation.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Robotics policy transfer method, not an LLM benchmark.
Co2In: a Bi-level Memory Incremental Learning Framework with Knowledge Encoding, Consolidation, and Integration
Proposes a bi-level working and long-term memory framework to balance knowledge retention and acquisition in incremental learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes an incremental learning framework, not an evaluation benchmark.
CIM-Embed: Learning Instruction-Conditioned Multimodal Embeddings for Clustering
Learns instruction-conditioned multimodal representations to dynamically cluster objects based on user-specified partition criteria without fixed cluster counts.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Presents an embedding clustering benchmark, not an LLM evaluation framework.
RoleQ: Role-Aligned Scales for Converting Language Models to Ternary
Proposes a structural scaling method based on transformer unit roles to convert language models to ternary weights effectively.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a quantization algorithm rather than an evaluation benchmark.
Provably Efficient Risk-Sensitive Offline Reinforcement Learning via Optimized Certainty Equivalents
Develops pessimistic value-iteration algorithms with theoretical suboptimality bounds for offline risk-sensitive reinforcement learning using optimized certainty equivalents.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Theoretical statistical bounds, not an LLM evaluation benchmark.
Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation
Presents a unified framework with synthetic data generation and benchmarks to train models on embodied spatial reasoning and actions.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a dataset/benchmark for spatial robotics, not language model evaluation.
In-Context Learning Before Specialisation: Theory of Learning in a Solvable Topic Model
Develops a solvable topic model theory explaining when sequence models adopt in-context learning rather than specialised memorisation during training.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Theoretical statistical physics model, not an LLM benchmark.
CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness
Equips multimodal vision-language models with video world model operations as tools to support dynamic spatiotemporal visual reasoning.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Presents a reasoning agent framework, not a benchmark or evaluation methodology.
Learning Rewards in Strategic Games
Analyzes strategic identifiability in multi-agent games, showing when inverse reinforcement learning fails to recover true underlying agent rewards.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Theoretical game-theoretic bounds, not an LLM benchmark framework.
CodeHealth Predicts the Token Cost of Agentic Code Review: A Pre-Registered Study of 465 Agent-Authored Pull Requests
Examines whether source code quality metrics predict the token costs of multi-agent pull request review pipelines.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Observational empirical study rather than an LLM evaluation benchmark.
BridgeAfford: Bridging Query-Target Gap for Generalizable 3D Affordance Grounding
Introduces a framework that aligns interaction regions across objects to improve 3D affordance grounding on unseen objects.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Vision model methodology rather than an LLM evaluation framework.
Agentic-Priors: Using Large Language Models to Address the Cold Start Problem in Preference Elicitation
Uses large language models to construct prior trade-off preferences to address cold-start challenges in choice-learning systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Evaluates preference elicitation methods rather than serving as an LLM benchmark.
Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI
Investigates how user trust influences delegation and verification choices during human interaction with multimodal video question-answering systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Human-subject interaction study rather than an LLM evaluation benchmark.
Why Shallow Neural Networks Learn Sinusoidal Components First: An Orthogonal Polynomial Dynamics Framework
Presents a theoretical orthogonal polynomial framework explaining why shallow neural networks learn low-frequency sinusoidal components before high frequencies.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on mathematical theory of gradient descent, not LLM benchmarks.
Time to Fake It: Continual Machine Learning Intensifies Unfairness in Deepfake Detection
Analyzes how continual learning methods affect demographic fairness over time across eleven deepfake generation techniques.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Studies deepfake classifier fairness over time rather than LLM benchmarking or evaluation.
GraphBEAT: Graph-based Bucketized Event Aggregation Over Time for Early Risk Stratification of Gastrointestinal Cancers
The paper aggregates irregular electronic health records into temporal graphs to predict risks of gastrointestinal cancers.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a clinical risk prediction model rather than LLM benchmarking or evaluation.
CARA: Causally Guided Retrieval Agent for Question Answering
The paper guides knowledge-graph retrieval agents by evaluating the causal impact of evidence on answering questions rather than text similarity.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a retrieval system rather than general LLM evaluation frameworks or benchmarks.
Priming Base Models for Agentic Post-Training: An Open Midtraining Recipe
The paper outlines a long-context midtraining stage using software engineering data to prepare base language models for agentic tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Evaluates on existing SWE benchmarks rather than introducing new evaluation methods or benchmarks.
DemoStream: Batched Task-and-Motion-Plan Optimization for Automated Learning from Demonstration
The paper optimizes batched task and motion planning to generate high-quality autonomous demonstrations for robotic manipulation training.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Addresses robotic motion planning rather than language model benchmarks or evaluation methods.
Decoding Naturalistic Speech from fMRI with Temporal Modeling and Multimodal Alignment
The paper aligns functional brain scans with multimodal representations to decode and retrieve perceived natural speech segments.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Applies to neuroscience fMRI decoding rather than LLM benchmarks or evaluation.
Progress Reward Model for Reinforcement Learning via Large Language Models
The paper uses language model subtask decomposition and dense progress tracking to enhance reinforcement learning on long-horizon tasks.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on reward shaping for reinforcement learning, not LLM benchmarking or evaluation.
FAOPs: Normal Forms and an Algebra for AI Agent Workflows
The paper provides a formal algebraic framework and normal forms to structure and audit enterprise AI agent workflows.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes workflow normalization theory rather than benchmarking or evaluating LLM capabilities.
When Reasoning Is Not Enough: Proactive Inquiry for Cross-Modal Safety in Multimodal Large Language Models
The paper enables multimodal models to proactively ask clarifying questions when ambiguous inputs carry cross-modal safety risks.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a safety inquiry framework rather than new general LLM evaluation methodologies.
Memory as Weights: Internalizing Long-Term History for Streaming Videos
The paper compresses video history into evolving lightweight model weights instead of competing for limited input context length.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a video memory architecture rather than new general LLM evaluation benchmarks.
Learning from Unverified Peers via Shared Residual Distillation
The paper develops a self-distillation approach enabling models to learn from their own unverified alternative reasoning paths without ground-truth answers.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Introduces a distillation training technique rather than testing or benchmarking methodologies.
Multi-SFT: Permissively-Licensed Multilingual Instruction-Following
The paper introduces a commercially permissive multilingual instruction dataset covering five European languages to train open language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Contributes an instruction-tuning dataset rather than proposing new evaluation methodologies or benchmarks.
TIPS: A Tiny Inference-time Policy for Scaling in Diffusion Language Models
The paper presents a tiny learned policy controller to optimize token unmasking and remasking schedules in diffusion language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on decoding algorithms rather than novel evaluation methodologies or benchmarks.
Causal Integrated Gradients: Scalable Feature Attribution Along Causal Paths
The paper extends integrated gradients to trace feature attributions along causal paths for high-dimensional models.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Evaluates explainability methods, not LLM capabilities, judges, or evaluation benchmarks.
Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization
The paper personalizes mixture-of-experts models and analyzes which specialized experts encode distinct user-specific features.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on mechanistic interpretability rather than evaluation benchmarks.
DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction
The paper proposes a decoupled per-token scoring method to efficiently manage key-value cache memory during long-context generation.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes an eviction algorithm, not an evaluation benchmark.
CART: Compatible Routing for Multimodal Continual Instruction Tuning
The paper coordinates projector and language model adaptation using task-specific routing to reduce catastrophic forgetting in multimodal models.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Proposes a training method, not an evaluation benchmark.
Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions
The paper demonstrates that a single adversarial agent can cause benign models in multi-agent discussions to quietly adopt false beliefs.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Investigates adversarial peer dynamics, not evaluation benchmark development.
961–1,020 of 3,345← PreviousNext →