Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Functional Subnetwork Localization for Efficient Continual Learning in Large Language Models Introduces an optimization framework that localizes functional subnetworks in language models to enable continual learning without catastrophic forgetting. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a continual learning framework, not an evaluation benchmark. | |
| Agent Status Protocol (ASP): A Lightweight Specification for State Reporting in Multi-Agent Systems Proposes a lightweight protocol for AI agents to report runtime status and liveness to central servers and monitoring dashboards. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Defines an operational specification, not a testing benchmark. | |
| Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond Reviews and analyzes reinforcement learning methods used to guide and improve diffusion models across vision, language, and robotics. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Reviews RL-driven diffusion methods rather than evaluating LLM benchmarks. | |
| When Is Muon Optimal? Radial Fragility and Minimax Geometry The paper investigates the mathematical conditions under which the Muon optimizer's polar update acts as an optimal step. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Theoretical math and optimization paper, not an evaluation benchmark. | |
| Uncertainty Quantification in Pairwise Difference Learning for Classification The authors formulate classification and uncertainty quantification methods for pairwise difference learning frameworks. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies classification uncertainty, not LLM evaluation or benchmarks. | |
| BiShield-TEE: On the (In-)Security of Unilateral Weight Obfuscation in On-Device TEE-Shielded LLM Partition The paper demonstrates vulnerabilities in unilateral weight obfuscation schemes used for on-device secure language model inference. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on security vulnerabilities, not model evaluation benchmarks. | |
| Independent Data-Integrity Verification for LLM-Driven Functional Coverage Closure in Hardware Design The authors present an agent loop that closes functional test coverage in hardware design using independent simulation scoreboards. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Describes a specific agent workflow rather than general evaluation methodology. | |
| Learning to Search for Executable Patternmaking from Certified Programs The paper proposes a search framework to recover executable editing programs between before-and-after sewing pattern pairs. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a search framework, not a general evaluation benchmark. | |
| AVALON: Zero-Shot Indoor Navigation with Human-Seeded Topological Memory The authors propose an indoor navigation framework that uses user-provided floor plans and topological memory without prior robot site maps. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Presents a robotics navigation method, not an LLM benchmark. | |
| LOADBench: A Large Open Analog Dataset and Benchmark for Machine Learning in IC Design The paper introduces an open-source dataset and standardized benchmark suite for machine learning methods in analog integrated circuit design. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on analog IC design metrics, not LLM evaluation. | |
| LoopAhead: Speculating Ahead for Faster Decoding in Looped Language Models The paper introduces a speculative decoding framework that uses early recurrent states to draft tokens in looped transformers. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes an inference speedup method, not an evaluation framework. | |
| Decoding What iOS Location Services Send to Apple: An LLM Is an Unreliable Analyst but a Useful Toolmaker The study evaluates using language models to directly reconstruct mobile network schemas versus generating validation code tools. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies protocol reverse-engineering accuracy, not general LLM benchmarks. | |
| Learning Intrinsic Dynamics in Latent World Models The paper studies whether predicting actions from consecutive latent states helps world models retain essential environmental dynamics. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies latent representation dynamics, not LLM benchmarking frameworks. | |
| Qwen-Audio-Jev: A Unified Interface for Audio Decisions The authors introduce an audio model with a non-autoregressive decision head for selection, judgment, and scoring tasks. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on an audio model architecture, not benchmark methodology. | |
| Efficient Pairwise Difference Learning: A Comparative Study of Encoding Strategies and Training Pair Selection The paper evaluates feature encoders and pair selection strategies for pairwise difference learning in low-data classification regimes. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies classical classification encoders, not LLM evaluation benchmarks. | |
| The Self-Improvement Problem The paper formalizes the theoretical limits of automated gates evaluating self-improvement updates in autonomous agent code. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on theoretical computability rather than empirical benchmarking. | |
| Router Drift Control: Mitigating Off-Policy Degradation in Mixture-of-Experts Reinforcement Learning The paper proposes filtering high-drift responses to mitigate off-policy degradation in mixture-of-experts reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes an RL training algorithm rather than LLM benchmarking. | |
| Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures The paper uses human interventions to localize and steer computations behind agent failure to decide between acting and clarifying. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on mechanistic interpretability rather than benchmark development. | |
| Encoded but Exposed: Language Embeddings can Reveal More Than They Should in Recommender Systems The authors evaluate how easily item identities and user profiles can be recovered from language embeddings in recommender systems. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies privacy leakage rather than general LLM evaluation benchmarks. | |
| FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning The authors introduce a Fisher-informed adapter merging method to maintain retained task performance during federated language model unlearning. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes an unlearning algorithm rather than general benchmark evaluation. | |
| In-Context Preference-Conditioned Pareto Set Learning from Limited Offline Data Introduces an in-context learning approach to map specified user preferences directly to Pareto-optimal solutions using offline data. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Deals with hypernetwork optimization methods, not LLM evaluation frameworks. | |
| Reliable Knowledge Acquisition for Continual Learning Agents Proposes a structured knowledge admission and verification system to prevent continual learning agents from storing harmful past experience entries. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a knowledge acquisition system rather than LLM evaluation methodology. | |
| The Delegation Dilemma: Economies of Scale, Accountability, and Polycentric Governance Models repeated games with endogenous delegation to analyze trade-offs between economies of scale and institutional accountability. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on multi-agent governance dynamics, not LLM benchmark evaluation. | |
| Harmful Partial Interventions and Benign Leakage in Concept-based Models Investigates how partial interventions in concept-based models can unexpectedly reduce downstream task performance due to information leakage. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies concept intervention harm rather than LLM benchmarking methods. | |
| DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents Develops a domain harness and policy learning pipeline to improve language model agent execution in computer-aided design environments. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a CAD agent framework, not a general LLM benchmark. | |
| CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge Introduces a two-stage coarse-to-fine speech separation architecture leveraging visual streams to isolate target speaker audio in noisy environments. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Speech processing model, not an LLM evaluation benchmark. | |
| DINO-FIL: Multi-Layer Transformer Fusion for Generative Inpainting Forgery Localization Combines multi-layer vision transformer representations with a fusion decoder to localize pixel-level generative image inpainting manipulations. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Image forensic detection model, not an LLM benchmark. | |
| RSIFlow: Adaptive Self-Improvement Workflows with an Evolving Meta-Agent Develops a recursive self-improvement framework where an evolving meta-agent adapts agent workflows based on execution trajectories and feedback. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on agent self-improvement architecture rather than LLM benchmarking. | |
| Cross-Embodiment Causal Transfer from Human Videos to Robot Manipulation Introduces a causal-beam transfer framework that extracts relevant subtask representations from human videos to guide robotic manipulation. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Robotics policy transfer method, not an LLM benchmark. | |
| Co2In: a Bi-level Memory Incremental Learning Framework with Knowledge Encoding, Consolidation, and Integration Proposes a bi-level working and long-term memory framework to balance knowledge retention and acquisition in incremental learning. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes an incremental learning framework, not an evaluation benchmark. | |
| CIM-Embed: Learning Instruction-Conditioned Multimodal Embeddings for Clustering Learns instruction-conditioned multimodal representations to dynamically cluster objects based on user-specified partition criteria without fixed cluster counts. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Presents an embedding clustering benchmark, not an LLM evaluation framework. | |
| RoleQ: Role-Aligned Scales for Converting Language Models to Ternary Proposes a structural scaling method based on transformer unit roles to convert language models to ternary weights effectively. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a quantization algorithm rather than an evaluation benchmark. | |
| Provably Efficient Risk-Sensitive Offline Reinforcement Learning via Optimized Certainty Equivalents Develops pessimistic value-iteration algorithms with theoretical suboptimality bounds for offline risk-sensitive reinforcement learning using optimized certainty equivalents. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Theoretical statistical bounds, not an LLM evaluation benchmark. | |
| Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation Presents a unified framework with synthetic data generation and benchmarks to train models on embodied spatial reasoning and actions. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a dataset/benchmark for spatial robotics, not language model evaluation. | |
| In-Context Learning Before Specialisation: Theory of Learning in a Solvable Topic Model Develops a solvable topic model theory explaining when sequence models adopt in-context learning rather than specialised memorisation during training. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Theoretical statistical physics model, not an LLM benchmark. | |
| CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness Equips multimodal vision-language models with video world model operations as tools to support dynamic spatiotemporal visual reasoning. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Presents a reasoning agent framework, not a benchmark or evaluation methodology. | |
| Learning Rewards in Strategic Games Analyzes strategic identifiability in multi-agent games, showing when inverse reinforcement learning fails to recover true underlying agent rewards. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Theoretical game-theoretic bounds, not an LLM benchmark framework. | |
| CodeHealth Predicts the Token Cost of Agentic Code Review: A Pre-Registered Study of 465 Agent-Authored Pull Requests Examines whether source code quality metrics predict the token costs of multi-agent pull request review pipelines. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Observational empirical study rather than an LLM evaluation benchmark. | |
| BridgeAfford: Bridging Query-Target Gap for Generalizable 3D Affordance Grounding Introduces a framework that aligns interaction regions across objects to improve 3D affordance grounding on unseen objects. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Vision model methodology rather than an LLM evaluation framework. | |
| Agentic-Priors: Using Large Language Models to Address the Cold Start Problem in Preference Elicitation Uses large language models to construct prior trade-off preferences to address cold-start challenges in choice-learning systems. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Evaluates preference elicitation methods rather than serving as an LLM benchmark. | |
| Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI Investigates how user trust influences delegation and verification choices during human interaction with multimodal video question-answering systems. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Human-subject interaction study rather than an LLM evaluation benchmark. | |
| Why Shallow Neural Networks Learn Sinusoidal Components First: An Orthogonal Polynomial Dynamics Framework Presents a theoretical orthogonal polynomial framework explaining why shallow neural networks learn low-frequency sinusoidal components before high frequencies. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on mathematical theory of gradient descent, not LLM benchmarks. | |
| Time to Fake It: Continual Machine Learning Intensifies Unfairness in Deepfake Detection Analyzes how continual learning methods affect demographic fairness over time across eleven deepfake generation techniques. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Studies deepfake classifier fairness over time rather than LLM benchmarking or evaluation. | |
| GraphBEAT: Graph-based Bucketized Event Aggregation Over Time for Early Risk Stratification of Gastrointestinal Cancers The paper aggregates irregular electronic health records into temporal graphs to predict risks of gastrointestinal cancers. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a clinical risk prediction model rather than LLM benchmarking or evaluation. | |
| CARA: Causally Guided Retrieval Agent for Question Answering The paper guides knowledge-graph retrieval agents by evaluating the causal impact of evidence on answering questions rather than text similarity. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a retrieval system rather than general LLM evaluation frameworks or benchmarks. | |
| Priming Base Models for Agentic Post-Training: An Open Midtraining Recipe The paper outlines a long-context midtraining stage using software engineering data to prepare base language models for agentic tasks. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Evaluates on existing SWE benchmarks rather than introducing new evaluation methods or benchmarks. | |
| DemoStream: Batched Task-and-Motion-Plan Optimization for Automated Learning from Demonstration The paper optimizes batched task and motion planning to generate high-quality autonomous demonstrations for robotic manipulation training. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Addresses robotic motion planning rather than language model benchmarks or evaluation methods. | |
| Decoding Naturalistic Speech from fMRI with Temporal Modeling and Multimodal Alignment The paper aligns functional brain scans with multimodal representations to decode and retrieve perceived natural speech segments. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Applies to neuroscience fMRI decoding rather than LLM benchmarks or evaluation. | |
| Progress Reward Model for Reinforcement Learning via Large Language Models The paper uses language model subtask decomposition and dense progress tracking to enhance reinforcement learning on long-horizon tasks. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on reward shaping for reinforcement learning, not LLM benchmarking or evaluation. | |
| FAOPs: Normal Forms and an Algebra for AI Agent Workflows The paper provides a formal algebraic framework and normal forms to structure and audit enterprise AI agent workflows. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes workflow normalization theory rather than benchmarking or evaluating LLM capabilities. | |
| When Reasoning Is Not Enough: Proactive Inquiry for Cross-Modal Safety in Multimodal Large Language Models The paper enables multimodal models to proactively ask clarifying questions when ambiguous inputs carry cross-modal safety risks. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a safety inquiry framework rather than new general LLM evaluation methodologies. | |
| Memory as Weights: Internalizing Long-Term History for Streaming Videos The paper compresses video history into evolving lightweight model weights instead of competing for limited input context length. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a video memory architecture rather than new general LLM evaluation benchmarks. | |
| Learning from Unverified Peers via Shared Residual Distillation The paper develops a self-distillation approach enabling models to learn from their own unverified alternative reasoning paths without ground-truth answers. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Introduces a distillation training technique rather than testing or benchmarking methodologies. | |
| Multi-SFT: Permissively-Licensed Multilingual Instruction-Following The paper introduces a commercially permissive multilingual instruction dataset covering five European languages to train open language models. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Contributes an instruction-tuning dataset rather than proposing new evaluation methodologies or benchmarks. | |
| TIPS: A Tiny Inference-time Policy for Scaling in Diffusion Language Models The paper presents a tiny learned policy controller to optimize token unmasking and remasking schedules in diffusion language models. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on decoding algorithms rather than novel evaluation methodologies or benchmarks. | |
| Causal Integrated Gradients: Scalable Feature Attribution Along Causal Paths The paper extends integrated gradients to trace feature attributions along causal paths for high-dimensional models. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Evaluates explainability methods, not LLM capabilities, judges, or evaluation benchmarks. | |
| Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization The paper personalizes mixture-of-experts models and analyzes which specialized experts encode distinct user-specific features. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Focuses on mechanistic interpretability rather than evaluation benchmarks. | |
| DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction The paper proposes a decoupled per-token scoring method to efficiently manage key-value cache memory during long-context generation. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes an eviction algorithm, not an evaluation benchmark. | |
| CART: Compatible Routing for Multimodal Continual Instruction Tuning The paper coordinates projector and language model adaptation using task-specific routing to reduce catastrophic forgetting in multimodal models. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Proposes a training method, not an evaluation benchmark. | |
| Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions The paper demonstrates that a single adversarial agent can cause benign models in multi-agent discussions to quietly adopt false beliefs. Preprint | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | Not relevant Investigates adversarial peer dynamics, not evaluation benchmark development. |
961–1,020 of 3,345← PreviousNext →