Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| MorphAct: Robot Policies Morphing with the Worlds They Act In The paper proposes a contextual parameterization framework that dynamically adjusts robot policy parameters as interaction contexts change. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a robotics parameterization framework rather than a benchmark. | |
| GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation The paper introduces an agentic framework that removes peripheral visual clues to protect geolocation privacy in images without adding visible artifacts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Introduces a defense framework rather than a general evaluation benchmark. | |
| Beyond Correctness: Compute-Responsive Data Selection for Reasoning Model Post-Training The paper introduces a data selection strategy that prioritizes training examples where reasoning performance improves with additional inference compute. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes data selection for training rather than evaluation benchmarks. | |
| FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs The paper proposes a vision-language-action model that dynamically crops high-resolution regions to manipulate objects without using a wrist camera. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a VLA model rather than benchmark evaluation frameworks. | |
| Which Knowledge Should LLMs Trust? Uncovering a Generalizable Steering Direction Across Knowledge Conflicts The paper identifies an activation steering vector that controls whether language models rely on internal memory or retrieved external context. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on representation steering rather than benchmarking methodology. | |
| Trainable at Depth, Solvable at Small Size: What the Loss Surface of a Polynomial Activation Dictates for Designing, Initializing and Training Networks The paper investigates the loss surface of deep networks using a specific polynomial activation function without standard normalization layers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on loss surfaces rather than LLM evaluation benchmarks. | |
| Rethinking Prediction Horizons: Decoupling Model Queries from State Updates in Few-Step MeanFlow The paper studies the impact of separating prediction horizons from state update intervals during sampling in generative flow models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on sampling algorithms rather than evaluation benchmarks. | |
| Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering The paper compares three textual interface designs for optimizing prompts in multimodal audio-visual question answering systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Tests prompt optimization interfaces rather than benchmark methodologies. | |
| AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining The paper proposes a synthetic data pipeline that extracts atomic facts from source texts to guide factual pretraining for language models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Evaluates pretraining methods rather than proposing new LLM benchmarks. | |
| Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution The paper proposes an interface framework that tracks and controls application state changes made by graphical user interface agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an execution system and contract framework, not LLM evaluation benchmarks. | |
| From Spectral to Frobenius: When Muon Loses Its Spectral Implicit Bias The paper analyzes the mathematical implicit bias of practical Muon optimization compared to gradient descent on linearly separable classification problems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical analysis of optimization algorithms, not LLM benchmarking. | |
| ACR-Net: Mitigating Semantic Dominance via Contrastive Acoustic-Semantic Decoupling The paper presents a network to decouple acoustic and semantic representations when speech tone conflicts with transcript text. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Studies acoustic-semantic feature decoupling, not LLM evaluation benchmarks. | |
| Maximising Transparency in Context Compaction Improves Retention of Facts and Commitments for Lightweight Coding Agents The paper presents a deterministic context compaction method designed to preserve factual history and commitments in lightweight coding agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on agent memory retention methods rather than LLM benchmarking. | |
| DreamHMR: From Video Generation to Human Motion Modeling via Structural Focusing The paper presents a framework adapting video generation priors to improve 3D human body and hand motion reconstruction from video. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Evaluates computer vision mesh recovery, not LLM benchmarks. | |
| LLM-Based Policy Compliance Verification of Loan Applications The paper describes an automated system using language models to verify corporate loan applications against internal bank lending policies. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an application prototype rather than general LLM evaluation methodology. | |
| Value-Guided Repulsion for Offline Reinforcement Learning The paper proposes a value-guided repulsion method for offline reinforcement learning that aligns behavior regularization with action value estimates. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Evaluates offline RL benchmarks, not LLM evaluation. | |
| HEM-Med: A Hierarchical Agentic Memory Framework for Safe Multi-Center Medication Recommendation The paper introduces a hierarchical memory agent framework for multi-center medication recommendation that accounts for hospital differences and drug safety constraints. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on a clinical recommendation model, not general LLM benchmarking. | |
| SWE-Stream: Scaling Executable Training Data for SWE Agents via Progressive Construction and Elastic Streaming The paper introduces a framework that progressively constructs and streams executable training tasks from code repositories for software engineering agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on training data synthesis rather than proposing new evaluation benchmarks. | |
| Drivers of LLM Consensus Formation Under Competing Incentives: A Simulation Study The paper evaluates how open and closed language models reach consensus when presented with competing payoff incentives. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on multi-agent consensus dynamics rather than LLM benchmarking methodologies. | |
| What and Where in Identifying and Quantifying Conventions in Humans and AI Agents The paper analyzes implicit communication conventions between humans and AI agents in the cooperative card game Hanabi. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Investigates implicit conventions in Hanabi, not LLM benchmark evaluation. | |
| Robust Counterfactuals for Markov Decision Processes under Statistical and Causal Uncertainties The paper introduces a framework providing analytical bounds for counterfactual reasoning in sequential decision processes under statistical and causal uncertainty. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Covers MDP counterfactual inference bounds, not LLM evaluation benchmarks. | |
| Design Space Exploration of Reinforcement Learning Configurations for Post-Legalization Placement The paper explores reinforcement learning design configurations for post-legalization placement refinement in chip design. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on VLSI benchmark evaluations for RL, not LLMs. | |
| PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents The paper introduces a dataset and framework pairing synchronized point-of-view and panoramic video to evaluate multiplayer action-conditioned world models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on world modeling architecture rather than LLM evaluation benchmarks. | |
| Retrieval Over Training: Similarity search-based Model Selection for Time Series Anomaly Detection The paper proposes a retrieval framework that selects suitable anomaly detection models for time-series data using similarity search over existing datasets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Evaluates classical time series anomaly detectors, not LLM benchmarking. | |
| P2Patch: Exploit-Guided Vulnerability Repair The paper presents an adversarial framework where an exploitation agent iteratively attacks and refines automated patches generated by a repair agent. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on automated program repair rather than general LLM evaluation benchmarks. | |
| Long-Horizon RL Needs Muon The paper investigates an asynchronous training recipe combining the Muon optimizer, token-averaged loss, and penalties for long-horizon agent tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Analyzes an RL training recipe rather than introducing benchmarks. | |
| Harness Policy Distillation: Aligning Agent Policies with Runtime Semantics The paper introduces a distillation method that trains agent policies on explicit runtime control semantics recovered from replayed execution traces. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on policy distillation methods, not benchmark evaluations. | |
| FUSE: Fairness-aware Update Screening against Byzantine Exploitation in $q$-Fair Federated Learning The paper studies Byzantine robustness in fair federated learning and proposes an update screening method using client trajectory consistency. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes defense screening against Byzantine updates, not LLM benchmarking. | |
| CASI: Credit Assignment via Set Intervention for Agentic Retrieval The paper presents an intervention method using Shapley values to assign credit to individual actions within multi-action agentic retrieval sets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an attribution algorithm, not benchmark evaluation methodologies. | |
| Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence The paper introduces a brain-inspired reflection framework that diagnoses failure points to guide self-evolving agents in embodied spatial tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an agent architecture rather than an evaluation benchmark. | |
| Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis The paper detects backdoor triggers in multimodal language models by tracking output evolution trajectories across internal hidden layers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an attack detection framework, not a general benchmark. | |
| Argument Graph Uncertainty: Quantifying Uncertainty from the Logical Structure of Reasoning Chains The paper estimates reasoning confidence by segmenting chain-of-thought traces into argument graphs evaluated through natural language inference. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Introduces an uncertainty estimation method rather than benchmark evaluation. | |
| TreeFlex: Agents Navigating Their Own Search Trees The paper proposes a framework where an agent policy navigates a global search tree by alternating between reflection and execution roles. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an agent framework, not benchmark evaluation methodologies. | |
| Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation The paper presents a benchmark dataset evaluating unified page-level document parsing alongside alternative text descriptions for visual elements. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Introduces a document parsing dataset rather than LLM-wide evaluation. | |
| Non-asymptotic Convergence of Average-reward Q-learning with Options The paper provides finite-sample convergence guarantees for average-reward option Q-learning algorithms under inter- and intra-option settings. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Contains theoretical convergence bounds, not LLM benchmark evaluation. | |
| Lifted State Policy Optimization: Internalizing Self-Correction through Transition Geometry The paper proposes a policy optimization method that treats reasoning transitions as learned coordinates in an energy space to internalize self-correction. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an optimization algorithm, not evaluation datasets or benchmarks. | |
| Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Hand The paper retargets object motion rather than human hands from video demonstrations to generate post-training data for various robot embodiments. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents a robot retargeting method rather than benchmark evaluation. | |
| From Relevance to Validity: Zero-Shot Tool Selection via Functional and Contextual Validation The paper proposes a progressive validation framework for zero-shot tool selection that evaluates functional compatibility and contextual relevance. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a tool selection framework rather than an evaluation benchmark. | |
| Cortex: Consolidating Context into Parametric Memory The paper presents a method to consolidate context gains into parametric model weights using prospective queries and low-rank feed-forward updates. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a memory consolidation method, not general LLM benchmarking. | |
| When Does Momentum Help in Reinforcement Learning with Verifiable Rewards? The paper analyzes when first-moment momentum accelerates reinforcement learning with verifiable rewards under exact and sampled policy gradients. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Analyzes training optimization dynamics rather than benchmark evaluation methodologies. | |
| One Size Does Not Fit All: Curvature-Aware Adaptive Perturbation for SAM The paper introduces an adaptive perturbation method for sharpness-aware minimization that modulates perturbation radii using local loss curvature. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on an optimization algorithm, not LLM benchmark evaluation. | |
| OrionMoE-v1.0: A Mixture-of-Experts Foundation Model for Tabular In-Context Learning The paper introduces a compact tabular foundation model combining distribution-aware representations with dataset-conditioned sparse mixture-of-experts computation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a model architecture, not a general evaluation benchmark. | |
| Analyzing performance of Retrieval Augmented Generation models for Question Answering Tasks The paper analyzes the performance of retrieval-augmented generation architectures on open-domain question answering tasks involving culturally grounded South Asian narratives. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Empirical analysis of RAG factors, not a benchmark framework. | |
| SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarm The paper presents a recursive self-improvement framework using scientific agent swarms that mutate hypotheses and recombine code based on experimental feedback. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an agent system rather than an evaluation benchmark. | |
| From Training to Escalation: Forensic Analysis and Local Recreation of RL/RLHF-Induced Privilege Escalation in AI Agents (CVE-2026-65616) Recreates and analyzes infrastructure misconfigurations that enabled privilege escalation and repository bypass during autonomous AI agent evaluations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Forensic security analysis rather than benchmark methodology. | |
| Selective Growing Q-Networks (SGQN): An Analysis of Adaptive Action Grids in Decoupled Q-Learning Implements adaptive action grids in value-based reinforcement learning that selectively refine promising bins while pruning suboptimal actions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes continuous control RL grids, not LLM evaluation. | |
| SafeAdapt-Poker: Counterfactual Risk Calibration for Budgeted Adaptation under Opponent Shift Introduces a counterfactual risk management method to calibrate adaptive decision-making against shifting opponent behaviors within fixed deviation budgets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an adaptation algorithm, not an evaluation benchmark. | |
| Quantifying privacy risks in foundation model representations of brain MRI Evaluates patient linkage and attribute inference risks present in brain magnetic resonance imaging representations generated by pretrained foundation models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Privacy risk analysis rather than a general LLM benchmark. | |
| Hindsight-Privileged RLVR: Single-Rollout Token Credit Without Group Sampling Derives token-level credit from single rollouts using hindsight future context rather than sampling multiple attempts per prompt. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an RL training algorithm rather than an evaluation benchmark. | |
| VascuSR: Iterative Anatomy-Aware Diffusion for CT Super-Resolution Uses explicit three-dimensional vascular guidance in an iterative diffusion pipeline to improve anatomical accuracy in computed tomography super-resolution. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a generative method, not an evaluation framework. | |
| VASPO: Self-Distillation with Privileged Value Estimation Combines privileged teacher signals with value estimation in policy optimization to provide denser token-level supervision for reasoning tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an RL training algorithm, not an evaluation method. | |
| The Wealth of Agents: Scaling Agentic AI Across Developers Studies multi-developer agentic systems where independently built specialist agents collaborate to outperform larger systems created by single developers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Evaluates existing benchmarks rather than proposing evaluation methodology. | |
| ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps Presents a graph-based framework with decision certificates to determine when multimodal agents should acquire visual evidence under cost constraints. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents an acquisition algorithm rather than an evaluation benchmark. | |
| PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis Introduces a decomposed rubric synthesis method to create training data for open multimodal models that generate visual code artifacts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on data pipeline and training, not evaluation. | |
| Detection of Potato Plant Leaf Diseases using Convolutional Neural Networks Develops and tests a lightweight convolutional neural network to classify potato leaf diseases on field-collected farm images. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Applies existing metrics to leaf disease classification. | |
| PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition Proposes an interactive agent framework that utilizes physics simulation and spatial exploration for complex 3D object assembly and composition. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on interactive composition framework, not benchmark methodology. | |
| Scaling Discovery Requires Forgetting Shows that periodically clearing agent search history and restarting from the top candidate prevents automated research agents from plateauing. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on agent search strategies rather than benchmark design. | |
| Recovering Reliable Supervision via Critique-Guided On-Policy Distillation Uses teacher critiques on incorrect student rollouts to improve on-policy distillation and recover supervision during mathematical reasoning tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a training method rather than an evaluation framework. | |
| One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness Introduces a self-supervised consistency loss across varied tool interfaces to make language model agents robust against notation and naming changes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a training method, not a new evaluation benchmark. | |
| Player-1: Learning to Play from Synthetic Experience Develops a post-training framework that trains computer-use agents for video games using synthetic interactive experiences and an expanded action space. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a training framework and environment, not an LLM evaluation benchmark. |
1,441–1,500 of 3,345← PreviousNext →