Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
MedEvo: Medical Reasoning Evolution through Knowledge Navigation
Proposes MedEvo, an iterative training framework that repairs multimodal medical reasoning trajectories using minimal hints and taxonomy-guided feedback.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a training framework rather than an evaluation benchmark.
zPocket: Better Pocket Finding with Frozen Co-Folding Features
Introduces the PocketWatch benchmark and zPocket, an approach training pocket-prediction heads on frozen representations from protein co-folding models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates biological pocket prediction, not LLM benchmarks.
Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity
Studies the trade-off between spatial smoothness and gene-level fidelity when mapping single-cell RNA sequencing profiles to images for neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Studies gene-to-image encoding, not LLM benchmark evaluation.
A Node Embedding Framework for Model-Centric Conformance Checking in Process Mining
Introduces a graph embedding and Procrustes alignment framework to provide a bounded metric for evaluating discovered process models against ground truth.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates business process models, not language models.
From Token Correction to Claim Admission: Training-Free Hallucination Mitigation for Large Vision-Language Models
Proposes a training-free framework that mitigates vision-language model hallucinations by admitting claims only when supported relative to a visual-null input.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a hallucination mitigation algorithm rather than a new benchmark.
Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learning
Develops SCRIM, a method quantifying state criticality in imitation learning by measuring downstream value degradation under bounded action perturbations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an imitation learning method, not an LLM benchmark.
Adaptive-Group Process Rewards for GUI Agents
Introduces an adaptive-group process reward framework that partitions GUI trajectories into subgoals to provide intermediate credit assignment for reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Develops a training reward framework rather than an evaluation benchmark.
ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolution
Proposes a recursive self-improvement framework for electrocardiogram analysis models combining verified synthetic waveform edits with targeted intervention selection.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Studies recursive self-improvement on ECGs, not general LLM evaluation.
Keep Your Receipts: Trustworthy Cleanup of Agent-Built Knowledge Graphs
Presents PolyGraph, a method storing provenance receipts during knowledge graph construction to enable precise updates when source documents are retracted.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on knowledge graph maintenance, not LLM benchmark evaluation.
Upstream Influence, Downstream Re-Anchoring in LLM Agent Chains
Analyzes how multi-agent workflow architecture affects the propagation and attenuation of coordinated stance manipulation across sequential agent chains.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Studies belief propagation rather than LLM benchmarking methodologies.
TSRL: Trigger-based Supervised Reinforcement Learning for Continual Agent Training
This paper proposes a training framework that triggers supervised fine-tuning specifically on failure states during reinforcement learning to prevent agent forgetting.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates on benchmarks but proposes a training framework, not evaluation.
SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models
This paper presents a compact decision model designed to screen malicious agent tool skills with high recall directly from specification files.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on malicious skill detection rather than general benchmark evaluation.
CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning
This paper proposes a credit-assignment method that uses rubric evaluation outcomes to allocate token-level advantages during reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on post-training RL optimization rather than benchmark evaluation.
Explore with Memory, Learn without It: In-Context Exploration and Self-Distillation for LLM Reasoning
This paper presents a reinforcement learning approach that uses in-context dynamic memory during rollouts and self-distillation to accelerate reasoning exploration.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a training framework rather than a testing benchmark.
Train for Many, Update with One: Improving Multi-Sample Reasoning via Fenchel-Bregman Posterior Learning
This paper introduces a posterior learning approach that improves multi-sample reasoning coverage by updating models using single posterior draws.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an optimization method rather than evaluation methodologies or benchmarks.
HiSTOR: Structured Treatment-outcome Representation Learning for High-Dimensional Longitudinal Data
This paper proposes an end-to-end framework integrating nonlinear dimension reduction with longitudinal counterfactual prediction for high-dimensional observational data.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on counterfactual prediction methods rather than LLM evaluation benchmarks.
Coupled Harness--Model Evolution for Scientific Equation Discovery
This paper presents a coupled evolution framework that co-adapts an executable tool library and a model's policy for scientific equation discovery.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a tool-learning method rather than a general LLM evaluation benchmark.
I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation
This paper presents a system combining interactive human corrections with iterative policy retraining for long-horizon whole-body mobile robot manipulation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an imitation learning system rather than an LLM evaluation benchmark.
Degrees of Freedom in Multi-Agent Coordination: Between Centralized and Decentralized Regimes
This paper introduces a framework that quantifies delegation flexibility to analyze the spectrum between centralized and decentralized multi-agent coordination.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces an architectural coordination framework rather than an LLM evaluation benchmark.
Gaussian Process Bandits for AI System Optimization with Selectively Verified Feedback
This paper proposes Gaussian process bandit algorithms with selective verification audits to optimize AI system configurations under noisy evaluations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on statistical GP bandit verification theory rather than standard LLM benchmarks.
Autonomous 3D Visual-Thermal Inspection for Utility-Scale Solar Farms
This paper presents an autonomous system combining LiDAR SLAM, visual imagery, and thermal sensing to inspect under-panel components of solar farms.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an industrial inspection system rather than an LLM benchmark.
Efficiently Learning To Reason or Not to Reason: Root-token Policy Optimization for Adaptive Thinking
This paper presents an optimization method that trains models to decide when to invoke reasoning tokens, reducing unnecessary thinking overhead.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an optimization recipe rather than an evaluation benchmark or judge audit.
Agentic4PDM: Host-Governed Evidence Admissibility for Industrial Fault Diagnosis
This paper introduces a framework combining language model agents with deterministic software controls for reliable sensor-based industrial fault diagnosis.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a diagnostic framework rather than a general LLM benchmark or evaluation methodology.
Posterior-Averaged Bellman Flow Matching for Distributional Critics
This paper proposes a flow-matching method that averages Bellman target directions under a posterior distribution to improve reinforcement learning critics.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an algorithmic RL training method rather than an LLM evaluation benchmark.
Learning from fracture: Teaching language models to design through physical experience
This paper introduces a framework that enables language models to optimize physical structural designs through simulated fracture experience and hypothesis revision.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a scientific design framework rather than a general LLM evaluation benchmark.
QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing
Introduces QK-Edit, a training-free query-key attention manipulation method for text-guided image and video editing in multimodal diffusion transformers.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an image/video editing method rather than an evaluation benchmark or methodology.
Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing
Proposes Diff Diffusion, a diffusion-based model that predicts localized code edit sequences rather than regenerating entire source files.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates code editing performance but does not contribute novel general LLM benchmarks or evaluation methods.
Agentic-MatriBO: Capability-Compiled Agentic Bayesian Optimization for Materials and Chemical Design
Introduces Agentic-MatriBO, a modular Bayesian optimization framework using LLM agents and deterministic compilation for material and chemical experiment design.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an optimization framework, not a general evaluation benchmark.
A Tutorial on Quantum Amplitude Embedding with Data Re-Uploading
Provides a tutorial analyzing theoretical expressiveness gains and parameter tradeoffs when re-uploading data in quantum amplitude embedding architectures.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Provides a theoretical tutorial on quantum embeddings, not LLM benchmarking.
Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models
Presents ADMA, an adaptive deliberation controller that dynamically adjusts multi-agent critique and coordination to improve reasoning accuracy.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on an adaptive multi-agent coordination system rather than benchmark design.
TStruct: Learning Shared Temporal Structures for Long-Term Time-Series Forecasting
Proposes TStruct, a network that captures recurring temporal relationship structures across variables to improve long-term time-series forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a forecasting model architecture, not an evaluation benchmark.
RT-J: Large-Scale Pretraining of Relational Transformers for Context-Efficient Predictions
Presents RT-J, a relational transformer pretrained on diverse databases to achieve strong in-context table predictions with few sample examples.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a model architecture and pretraining method, not an evaluation standard.
ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning
Presents ECMR, a dynamic evidence-aware controller that guides multi-agent deliberation steps to prevent false consensus and reduce redundant reasoning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a multi-agent control mechanism rather than an evaluation benchmark.
Cross-Lingual Transfer of Evil Vectors Is Directionally Asymmetric
Shows that evil persona vectors extracted from low-resource languages transfer poorly and fail to steer model behavior effectively across languages.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on activation vector steering rather than evaluation benchmark design.
Training LLMs for Multi-Agent Collaboration with Verifiable Information Rewards
Proposes CoSIR to train multi-agent collaboration policies using information-theoretic surprisal rewards that assess the helpfulness of communication.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a multi-agent training framework, not an evaluation benchmark.
PaceReasoner: Label-Free Learning to Answer Briefly from Long Reasoning
Introduces PaceReasoner, using long reasoning outputs during test-time reinforcement learning to boost the accuracy of brief, low-latency model answers.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a test-time RL method, not a benchmark or evaluation protocol.
DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving
Introduces DriveWLA, a mixture-of-transformers architecture unifying scene semantics, future dynamic prediction, and vehicle trajectory planning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an autonomous driving architecture, not an evaluation benchmark.
SpecCloak: Probing Harmful Code Generation through Engineering Specifications
Finds that framing malicious coding prompts as engineering specifications systematically reduces language model refusal rates across multiple models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on safety probing mechanisms rather than benchmark design.
LinMorph: Learning to Morph Weights for Efficient Video DiT Linearization
Proposes LinMorph, a learnable weight transformation method to initialize linear attention models from pretrained video diffusion transformers efficiently.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a weight morphing method, not a general evaluation framework.
CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation
Introduces CineMem, an attention-aligned memory retrieval framework using clustered KV caches for autoregressive multi-shot long video generation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a generation architecture, not an evaluation benchmark or methodology.
GLST: Global-Local Spatio-Temporal Memory Decomposition Framework for Online Chained-Goal Navigation
Presents a memory decomposition framework separating spatio-temporal beliefs to support autonomous robot navigation under evolving online goals.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on robot navigation frameworks, not LLM evaluation benchmarks.
Learning How to Remember: Memory Modality Selection for GUI Agents
Introduces SwitchMem, a routing system that dynamically selects between text and visual memory representations for vision-language GUI agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an agent memory method, not general evaluation benchmarks.
MERIT: Multimodal Evidence Reasoning over Image Tables
Proposes MERIT, a framework using visual table reasoning and adapted encoders to extract information directly from table images.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a training framework for table reasoning, not an evaluation benchmark.
AI-Enhanced Hyperspectral Imaging for Intraoperative Detection of Low-Grade Glioma: A Clinical Study
The clinical study compares hyperspectral and RGB imaging for intraoperative detection of low-grade gliomas during brain tumor surgery.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on clinical glioma classification, not LLM benchmarks.
HaloBlock: Faster and Better Decoding for Diffusion Large Language Models
HaloBlock allocates adaptive context halo regions across blocks to smooth context transitions and improve diffusion language model decoding.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an inference decoding mechanism, not an evaluation framework.
FETALFusion: Resolution-Aware State-Space Modeling for Multi-Domain Fetal Head Segmentation
FETALFusion combines CNN and Mamba architectures to segment fetal heads accurately across different ultrasound acquisition methods.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on medical image segmentation, not language model evaluation.
Virtual Head Attention
Virtual Head Attention uses two linear operations to compress key-value cache overhead without increasing training compute or sacrificing output quality.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an architectural design, not an LLM benchmark.
Better Capturing Interactions Between Products in~Retail: Revisited Negative Sampling for~Basket Choice Modeling
The paper proposes a shopping basket choice model using specialized negative sampling to capture product interactions from retail transactions.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Concerns basket choice embeddings, not LLM evaluation.
BELT : BEhavior-Aligned Low-Rank KV Cache Compression with Learned Top-k Rank Allocation
BELT compresses key-value caches using attention-distribution alignment and learned global rank allocation across model heads.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a compression framework, not an evaluation benchmark.
Seeing Depth but Choosing Cues in Vision-Language Models
The paper analyzes how vision-language models favor 2D image cues over internal 3D depth representations when judging relative distances.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Analyzes depth cues and internal representations, not benchmark methodology.
Saliency-Guided Replay for Continual Learning in Deep Spiking Neural Networks
The paper presents a saliency-guided patch replay method to mitigate catastrophic forgetting in spiking neural networks under tight memory budgets.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a replay strategy rather than LLM benchmarking.
Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models
The paper proposes predictability-aware supervised fine-tuning to resolve training and inference order mismatches in diffusion language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a training method, not a benchmark or evaluation framework.
Cost-Efficient Privacy Enforcement for Email-Generating LLM Agents under Strategic Information Requests
The paper introduces local contract-conditioned rewriting to prevent sensitive data leakage in email-generating language model agents cost-effectively.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an enforcement framework rather than general LLM evaluation benchmarks.
Correcting or Continuing? What On-Policy Distillation Learns from Student Errors
The study shows that training on-policy distillation exclusively on student errors degrades accuracy rather than improving it.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Analyzes student error distillation rather than establishing evaluation benchmarks.
LatentRemedy: Efficient Remedy For Non-Prefix KV Cache Reuse in Multi-Agent Systems
LatentRemedy uses task-conditioned latent tokens to allow safe key-value cache reuse across conflicting tasks in multi-agent systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an architectural inference remedy, not an evaluation benchmark.
SHELDON: Reasoning through Dual Search over Hypothesis and Observation Spaces
SHELDON introduces a dual-search reasoning framework that independently explores hypotheses and observation spaces to avoid confirmation bias.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a reasoning architecture rather than a benchmark or evaluation framework.
ChampionKV: Head-Wise Adaptive Budget Allocation for KV Cache Compression
ChampionKV adaptively allocates key-value cache memory budgets across attention heads using observation-window concentration proxies.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Develops a cache compression method rather than evaluation methodology.
Can Machine Learning Potentials Be More Accurate Than the Methods They Are Trained On?
The authors propose methods to train machine learning potentials that transfer across quantum-chemical methods to exceed single-method training accuracy.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on chemical simulation potentials rather than LLM benchmarks.
Scaling Vision Transformers Without Training: Prune-and-Merge Token Compression
The paper introduces a training-free token pruning and merging framework with new robustness metrics for vision transformers.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces metrics for token pruning robustness rather than LLM benchmarks.
High-fidelity Three-Dimensional Flow Field Reconstruction Driven by Turbulent Fluid Dynamics
The paper proposes a neural operator and state-space framework for high-fidelity 3D turbulent flow reconstruction from coarse data.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on physics simulation rather than LLM benchmarking.
2,581–2,640 of 3,345← PreviousNext →