Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| MedEvo: Medical Reasoning Evolution through Knowledge Navigation Proposes MedEvo, an iterative training framework that repairs multimodal medical reasoning trajectories using minimal hints and taxonomy-guided feedback. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a training framework rather than an evaluation benchmark. | |
| zPocket: Better Pocket Finding with Frozen Co-Folding Features Introduces the PocketWatch benchmark and zPocket, an approach training pocket-prediction heads on frozen representations from protein co-folding models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates biological pocket prediction, not LLM benchmarks. | |
| Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity Studies the trade-off between spatial smoothness and gene-level fidelity when mapping single-cell RNA sequencing profiles to images for neural networks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Studies gene-to-image encoding, not LLM benchmark evaluation. | |
| A Node Embedding Framework for Model-Centric Conformance Checking in Process Mining Introduces a graph embedding and Procrustes alignment framework to provide a bounded metric for evaluating discovered process models against ground truth. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates business process models, not language models. | |
| From Token Correction to Claim Admission: Training-Free Hallucination Mitigation for Large Vision-Language Models Proposes a training-free framework that mitigates vision-language model hallucinations by admitting claims only when supported relative to a visual-null input. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a hallucination mitigation algorithm rather than a new benchmark. | |
| Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learning Develops SCRIM, a method quantifying state criticality in imitation learning by measuring downstream value degradation under bounded action perturbations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an imitation learning method, not an LLM benchmark. | |
| Adaptive-Group Process Rewards for GUI Agents Introduces an adaptive-group process reward framework that partitions GUI trajectories into subgoals to provide intermediate credit assignment for reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Develops a training reward framework rather than an evaluation benchmark. | |
| ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolution Proposes a recursive self-improvement framework for electrocardiogram analysis models combining verified synthetic waveform edits with targeted intervention selection. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Studies recursive self-improvement on ECGs, not general LLM evaluation. | |
| Keep Your Receipts: Trustworthy Cleanup of Agent-Built Knowledge Graphs Presents PolyGraph, a method storing provenance receipts during knowledge graph construction to enable precise updates when source documents are retracted. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on knowledge graph maintenance, not LLM benchmark evaluation. | |
| Upstream Influence, Downstream Re-Anchoring in LLM Agent Chains Analyzes how multi-agent workflow architecture affects the propagation and attenuation of coordinated stance manipulation across sequential agent chains. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Studies belief propagation rather than LLM benchmarking methodologies. | |
| TSRL: Trigger-based Supervised Reinforcement Learning for Continual Agent Training This paper proposes a training framework that triggers supervised fine-tuning specifically on failure states during reinforcement learning to prevent agent forgetting. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates on benchmarks but proposes a training framework, not evaluation. | |
| SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models This paper presents a compact decision model designed to screen malicious agent tool skills with high recall directly from specification files. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on malicious skill detection rather than general benchmark evaluation. | |
| CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning This paper proposes a credit-assignment method that uses rubric evaluation outcomes to allocate token-level advantages during reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on post-training RL optimization rather than benchmark evaluation. | |
| Explore with Memory, Learn without It: In-Context Exploration and Self-Distillation for LLM Reasoning This paper presents a reinforcement learning approach that uses in-context dynamic memory during rollouts and self-distillation to accelerate reasoning exploration. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a training framework rather than a testing benchmark. | |
| Train for Many, Update with One: Improving Multi-Sample Reasoning via Fenchel-Bregman Posterior Learning This paper introduces a posterior learning approach that improves multi-sample reasoning coverage by updating models using single posterior draws. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an optimization method rather than evaluation methodologies or benchmarks. | |
| HiSTOR: Structured Treatment-outcome Representation Learning for High-Dimensional Longitudinal Data This paper proposes an end-to-end framework integrating nonlinear dimension reduction with longitudinal counterfactual prediction for high-dimensional observational data. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on counterfactual prediction methods rather than LLM evaluation benchmarks. | |
| Coupled Harness--Model Evolution for Scientific Equation Discovery This paper presents a coupled evolution framework that co-adapts an executable tool library and a model's policy for scientific equation discovery. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a tool-learning method rather than a general LLM evaluation benchmark. | |
| I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation This paper presents a system combining interactive human corrections with iterative policy retraining for long-horizon whole-body mobile robot manipulation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an imitation learning system rather than an LLM evaluation benchmark. | |
| Degrees of Freedom in Multi-Agent Coordination: Between Centralized and Decentralized Regimes This paper introduces a framework that quantifies delegation flexibility to analyze the spectrum between centralized and decentralized multi-agent coordination. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces an architectural coordination framework rather than an LLM evaluation benchmark. | |
| Gaussian Process Bandits for AI System Optimization with Selectively Verified Feedback This paper proposes Gaussian process bandit algorithms with selective verification audits to optimize AI system configurations under noisy evaluations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on statistical GP bandit verification theory rather than standard LLM benchmarks. | |
| Autonomous 3D Visual-Thermal Inspection for Utility-Scale Solar Farms This paper presents an autonomous system combining LiDAR SLAM, visual imagery, and thermal sensing to inspect under-panel components of solar farms. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an industrial inspection system rather than an LLM benchmark. | |
| Efficiently Learning To Reason or Not to Reason: Root-token Policy Optimization for Adaptive Thinking This paper presents an optimization method that trains models to decide when to invoke reasoning tokens, reducing unnecessary thinking overhead. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an optimization recipe rather than an evaluation benchmark or judge audit. | |
| Agentic4PDM: Host-Governed Evidence Admissibility for Industrial Fault Diagnosis This paper introduces a framework combining language model agents with deterministic software controls for reliable sensor-based industrial fault diagnosis. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a diagnostic framework rather than a general LLM benchmark or evaluation methodology. | |
| Posterior-Averaged Bellman Flow Matching for Distributional Critics This paper proposes a flow-matching method that averages Bellman target directions under a posterior distribution to improve reinforcement learning critics. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an algorithmic RL training method rather than an LLM evaluation benchmark. | |
| Learning from fracture: Teaching language models to design through physical experience This paper introduces a framework that enables language models to optimize physical structural designs through simulated fracture experience and hypothesis revision. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a scientific design framework rather than a general LLM evaluation benchmark. | |
| QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing Introduces QK-Edit, a training-free query-key attention manipulation method for text-guided image and video editing in multimodal diffusion transformers. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an image/video editing method rather than an evaluation benchmark or methodology. | |
| Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing Proposes Diff Diffusion, a diffusion-based model that predicts localized code edit sequences rather than regenerating entire source files. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates code editing performance but does not contribute novel general LLM benchmarks or evaluation methods. | |
| Agentic-MatriBO: Capability-Compiled Agentic Bayesian Optimization for Materials and Chemical Design Introduces Agentic-MatriBO, a modular Bayesian optimization framework using LLM agents and deterministic compilation for material and chemical experiment design. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an optimization framework, not a general evaluation benchmark. | |
| A Tutorial on Quantum Amplitude Embedding with Data Re-Uploading Provides a tutorial analyzing theoretical expressiveness gains and parameter tradeoffs when re-uploading data in quantum amplitude embedding architectures. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Provides a theoretical tutorial on quantum embeddings, not LLM benchmarking. | |
| Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models Presents ADMA, an adaptive deliberation controller that dynamically adjusts multi-agent critique and coordination to improve reasoning accuracy. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on an adaptive multi-agent coordination system rather than benchmark design. | |
| TStruct: Learning Shared Temporal Structures for Long-Term Time-Series Forecasting Proposes TStruct, a network that captures recurring temporal relationship structures across variables to improve long-term time-series forecasting. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a forecasting model architecture, not an evaluation benchmark. | |
| RT-J: Large-Scale Pretraining of Relational Transformers for Context-Efficient Predictions Presents RT-J, a relational transformer pretrained on diverse databases to achieve strong in-context table predictions with few sample examples. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a model architecture and pretraining method, not an evaluation standard. | |
| ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning Presents ECMR, a dynamic evidence-aware controller that guides multi-agent deliberation steps to prevent false consensus and reduce redundant reasoning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a multi-agent control mechanism rather than an evaluation benchmark. | |
| Cross-Lingual Transfer of Evil Vectors Is Directionally Asymmetric Shows that evil persona vectors extracted from low-resource languages transfer poorly and fail to steer model behavior effectively across languages. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on activation vector steering rather than evaluation benchmark design. | |
| Training LLMs for Multi-Agent Collaboration with Verifiable Information Rewards Proposes CoSIR to train multi-agent collaboration policies using information-theoretic surprisal rewards that assess the helpfulness of communication. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a multi-agent training framework, not an evaluation benchmark. | |
| PaceReasoner: Label-Free Learning to Answer Briefly from Long Reasoning Introduces PaceReasoner, using long reasoning outputs during test-time reinforcement learning to boost the accuracy of brief, low-latency model answers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a test-time RL method, not a benchmark or evaluation protocol. | |
| DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving Introduces DriveWLA, a mixture-of-transformers architecture unifying scene semantics, future dynamic prediction, and vehicle trajectory planning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an autonomous driving architecture, not an evaluation benchmark. | |
| SpecCloak: Probing Harmful Code Generation through Engineering Specifications Finds that framing malicious coding prompts as engineering specifications systematically reduces language model refusal rates across multiple models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on safety probing mechanisms rather than benchmark design. | |
| LinMorph: Learning to Morph Weights for Efficient Video DiT Linearization Proposes LinMorph, a learnable weight transformation method to initialize linear attention models from pretrained video diffusion transformers efficiently. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a weight morphing method, not a general evaluation framework. | |
| CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation Introduces CineMem, an attention-aligned memory retrieval framework using clustered KV caches for autoregressive multi-shot long video generation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a generation architecture, not an evaluation benchmark or methodology. | |
| GLST: Global-Local Spatio-Temporal Memory Decomposition Framework for Online Chained-Goal Navigation Presents a memory decomposition framework separating spatio-temporal beliefs to support autonomous robot navigation under evolving online goals. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on robot navigation frameworks, not LLM evaluation benchmarks. | |
| Learning How to Remember: Memory Modality Selection for GUI Agents Introduces SwitchMem, a routing system that dynamically selects between text and visual memory representations for vision-language GUI agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an agent memory method, not general evaluation benchmarks. | |
| MERIT: Multimodal Evidence Reasoning over Image Tables Proposes MERIT, a framework using visual table reasoning and adapted encoders to extract information directly from table images. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a training framework for table reasoning, not an evaluation benchmark. | |
| AI-Enhanced Hyperspectral Imaging for Intraoperative Detection of Low-Grade Glioma: A Clinical Study The clinical study compares hyperspectral and RGB imaging for intraoperative detection of low-grade gliomas during brain tumor surgery. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on clinical glioma classification, not LLM benchmarks. | |
| HaloBlock: Faster and Better Decoding for Diffusion Large Language Models HaloBlock allocates adaptive context halo regions across blocks to smooth context transitions and improve diffusion language model decoding. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an inference decoding mechanism, not an evaluation framework. | |
| FETALFusion: Resolution-Aware State-Space Modeling for Multi-Domain Fetal Head Segmentation FETALFusion combines CNN and Mamba architectures to segment fetal heads accurately across different ultrasound acquisition methods. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on medical image segmentation, not language model evaluation. | |
| Virtual Head Attention Virtual Head Attention uses two linear operations to compress key-value cache overhead without increasing training compute or sacrificing output quality. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an architectural design, not an LLM benchmark. | |
| Better Capturing Interactions Between Products in~Retail: Revisited Negative Sampling for~Basket Choice Modeling The paper proposes a shopping basket choice model using specialized negative sampling to capture product interactions from retail transactions. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Concerns basket choice embeddings, not LLM evaluation. | |
| BELT : BEhavior-Aligned Low-Rank KV Cache Compression with Learned Top-k Rank Allocation BELT compresses key-value caches using attention-distribution alignment and learned global rank allocation across model heads. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a compression framework, not an evaluation benchmark. | |
| Seeing Depth but Choosing Cues in Vision-Language Models The paper analyzes how vision-language models favor 2D image cues over internal 3D depth representations when judging relative distances. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Analyzes depth cues and internal representations, not benchmark methodology. | |
| Saliency-Guided Replay for Continual Learning in Deep Spiking Neural Networks The paper presents a saliency-guided patch replay method to mitigate catastrophic forgetting in spiking neural networks under tight memory budgets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a replay strategy rather than LLM benchmarking. | |
| Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models The paper proposes predictability-aware supervised fine-tuning to resolve training and inference order mismatches in diffusion language models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a training method, not a benchmark or evaluation framework. | |
| Cost-Efficient Privacy Enforcement for Email-Generating LLM Agents under Strategic Information Requests The paper introduces local contract-conditioned rewriting to prevent sensitive data leakage in email-generating language model agents cost-effectively. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an enforcement framework rather than general LLM evaluation benchmarks. | |
| Correcting or Continuing? What On-Policy Distillation Learns from Student Errors The study shows that training on-policy distillation exclusively on student errors degrades accuracy rather than improving it. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Analyzes student error distillation rather than establishing evaluation benchmarks. | |
| LatentRemedy: Efficient Remedy For Non-Prefix KV Cache Reuse in Multi-Agent Systems LatentRemedy uses task-conditioned latent tokens to allow safe key-value cache reuse across conflicting tasks in multi-agent systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an architectural inference remedy, not an evaluation benchmark. | |
| SHELDON: Reasoning through Dual Search over Hypothesis and Observation Spaces SHELDON introduces a dual-search reasoning framework that independently explores hypotheses and observation spaces to avoid confirmation bias. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a reasoning architecture rather than a benchmark or evaluation framework. | |
| ChampionKV: Head-Wise Adaptive Budget Allocation for KV Cache Compression ChampionKV adaptively allocates key-value cache memory budgets across attention heads using observation-window concentration proxies. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Develops a cache compression method rather than evaluation methodology. | |
| Can Machine Learning Potentials Be More Accurate Than the Methods They Are Trained On? The authors propose methods to train machine learning potentials that transfer across quantum-chemical methods to exceed single-method training accuracy. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on chemical simulation potentials rather than LLM benchmarks. | |
| Scaling Vision Transformers Without Training: Prune-and-Merge Token Compression The paper introduces a training-free token pruning and merging framework with new robustness metrics for vision transformers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces metrics for token pruning robustness rather than LLM benchmarks. | |
| High-fidelity Three-Dimensional Flow Field Reconstruction Driven by Turbulent Fluid Dynamics The paper proposes a neural operator and state-space framework for high-fidelity 3D turbulent flow reconstruction from coarse data. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on physics simulation rather than LLM benchmarking. |
2,581–2,640 of 3,345← PreviousNext →