Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Towards Resilience: Slice-Driven Orchestration of Mobile IoMT in 6G-Edge-Continuum
The paper introduces an adaptive network-slicing orchestration framework for medical IoT applications operating across edge-computing infrastructure.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on network orchestration rather than LLM evaluation.
The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow
The paper demonstrates that internal activation states can forecast and block unauthorized actions and deceptive reports by language model agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on action forecasting and gating rather than benchmark methodology.
Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows
The paper evaluates small language models for text-to-SQL tasks and tests lightweight iterative retry workflows to improve query accuracy.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates existing benchmarks rather than creating new testing frameworks.
StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions
The paper introduces decision models that balance fast single-pass predictions with adaptive reasoning for uncertain cases using reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a model training framework, not an evaluation benchmark.
Joint Embedding with Dynamic Integration network (JEDI-net)
The paper proposes clustering observations by feature importance profiles to incorporate latent factor representations into deep learning models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes model architecture rather than LLM evaluation benchmarks.
Do Theorem Provers Need Theorem-Proving Agents? mini-Lean-agent: A Coding-Agent Baseline for Lean
The paper presents a minimal coding agent baseline for Lean theorem proving using standard bash tooling instead of specialized harnesses.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates existing benchmarks rather than proposing a new LLM test.
Budgeted KV-Cache Repair for Evolving Contexts
The paper proposes a budgeted KV-cache repair technique to restore model performance efficiently after deleting obsolete context tokens.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an inference acceleration method, not an evaluation benchmark.
On the Statistical Mechanics of Attention
The paper presents a statistical mechanics framework using modern Hopfield models to analyze inference reliability and phase transitions in Transformer attention.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents theoretical physics analysis rather than empirical evaluation benchmarks.
MID: Mask-Image Distributional Divergence for Evaluating Medical Image Segmentation
The paper introduces a distribution-level evaluation metric for medical image segmentation to assess prediction sets without requiring paired ground-truth masks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Addresses medical image segmentation metrics rather than LLM benchmarks.
When Goals Leak Across Relationships: How Cached Goal Representations Shape Cross-Client Decisions
The paper examines how shared KV caches cause language model agents to leak goals across competing clients, offering internal intervention techniques.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on representation analysis and intervention, not benchmark development.
HASTE: Hierarchical and Attribute-aware Supervision for Generative Recommendation
The paper proposes a hierarchical and attribute-aware supervision method to improve training efficiency and long-tail performance in generative recommendations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a training method rather than LLM evaluation benchmarks.
What Makes a Latent Space Shared? Direct and Recoverable Compatibility in Motion VAEs
The authors analyze compatibility across multi-schema latent spaces in motion models, showing shared representations require explicit paired data to align.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Analyzes representation compatibility rather than LLM benchmarks or evaluation.
EPOCH: Coverage-Aware Evolution with Experiential Preference Optimization for LLM-based Automated Heuristic Design
The authors propose an evolutionary framework that optimizes instance coverage and updates language model weights to discover complementary optimization heuristics.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces an optimization algorithm rather than an LLM evaluation benchmark.
Mitigating Black-Box Score-Based Query Attacks via Gradient Confusion
The paper introduces a test-time wrapper that distorts exposed output probabilities to defend black-box machine learning models from query-based adversarial attacks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on adversarial defense mechanics rather than LLM benchmark evaluation.
Cross-Market Meta-Learning for Electricity Price Forecasting
The authors introduce a topology-aware transformer meta-trained across multiple electricity markets to forecast day-ahead electricity prices for unseen grids.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Addresses energy time-series forecasting, not LLM evaluation.
Learning to Play: Reinforcement Learning and Games
The authors provide a comprehensive textbook covering reinforcement learning methods, game-playing algorithms, and key historical milestones.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Book on game-playing RL methods, not LLM evaluation or benchmarks.
Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting
The paper develops a sequential betting approach to reliably detect data distribution shifts in unstructured text and image streams over time.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on statistical drift testing rather than LLM capability benchmarking.
Generalizable field of view extension for diffusion MRI via conditional flow matching
The authors propose a conditional flow-matching generative model to extend the field of view in diffusion brain MRI scans across scanners.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on MRI image reconstruction, not LLM benchmark evaluation.
Event-Centric Earthquake Monitoring with a Multi-Station Transformer
The paper presents a multi-station transformer model that jointly detects phase arrivals, locations, magnitudes, and associations for earthquake monitoring.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on seismic signal processing, not LLM evaluation benchmarks.
Cross-View Time-Frequency Diffusion for Extreme-Aware Time-Series Generation
The authors introduce a time-frequency diffusion framework that improves the generation of rare extreme events in time-series data.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Does not evaluate language models or present an LLM benchmark.
Agency as a New Organizing Abstraction for Computer Science
The paper argues that software agency should be treated as a core organizing abstraction in computer science rather than merely an AI application.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Conceptual perspective paper; does not introduce or analyze LLM benchmarks.
Bottlenecked semantic compression by representation reconstruction
The authors propose a visual token compression framework that reduces computational costs by retaining only visual tokens with high reconstruction residuals.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Does not evaluate language models or present an LLM benchmark.
Why Agentic Workflows Fail: A Taxonomy Derived from Literature and Empirical Data
The paper presents a taxonomy that locates agent workflow failures across specific workflow stages and agent functional capabilities.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Provides a failure taxonomy rather than a model evaluation benchmark.
ClearNav: Perception-Aligned Quadrotor Flight Using Differential-Physics
The authors present a flight navigation policy for quadrotors that penalizes movement outside the camera view to avoid collisions in cluttered environments.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Does not benchmark or evaluate language models.
On Making $\mathrm{SE}(2)$-Invariant Networks Optimal
The paper develops a plug-and-play module for convolutional neural networks that provides optimal rotation and translation invariance based on invariant theory.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Does not address language model evaluation or benchmarks.
Reinforcement Learning In Partially Verifiable Environments for Colon Cancer Treatment Planning
The authors formulate colon cancer treatment planning as an interactive reinforcement learning task in settings where actions are only partially verifiable.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on RL formulation for oncology, not LLM benchmark evaluation.
World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models
The paper proposes using test-time training memory to maintain consistent long-horizon visual scenes in real-time camera-controlled video world models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a video generation model, not general LLM benchmark evaluation.
SchemaWeaver: Accelerating On-Device Mobile Agentic AI via Schema-Guided Parallel LLM Decoding
The authors present a parallel decoding method that speeds up on-device tool calling for language model agents without requiring model retraining.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a decoding optimization rather than an evaluation benchmark.
The belief-action gap in language model agents
The authors examine why language model agents fail by analyzing discrepancies between internal representations of state values and actual action choices.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on internal agent mechanics rather than general LLM evaluation benchmarks.
An FPGA-Based Spiking Neural Network for Spatiotemporal Pattern Learning and Classification
The authors design an FPGA implementation of spiking neural networks that performs both inference and training on-chip without backpropagation through time.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents hardware implementation, not an LLM benchmark.
Assessing the Performance of AI Models in Misinformation Detection Using Predefined Social Noise Constructs
The paper evaluates seven machine learning and graph models on detecting misinformation within social media noise from conflict-related tweets.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates misinformation classifiers, not language model evaluation benchmarks.
REA: From Correct LLM Judgments to Safe Decision Delivery
The authors introduce a framework to track safety model judgments through output parsing to prevent malformed responses from causing bad decisions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates guardrail execution pipelines, not general LLM benchmarks.
VeriPIE: Checkable Query Plans and Evidence-Guided Selection for Text-to-SQL
The paper presents a neurosymbolic framework combining query plan checks and candidate selection to improve text-to-SQL translation for financial governance.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates on text-to-SQL datasets, but primary contribution is a neurosymbolic verification framework.
Foundation Models for Event Prediction Across Heterogeneous Event Logs
The paper presents an in-context foundation model architecture for next-event prediction across diverse operational event logs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a model architecture for event prediction, not an LLM benchmark.
YUBI-Real2Sim: 3DGS Scene Verification for Reliable Policy Evaluation
The paper introduces a framework combining 3D Gaussian Splatting and physical simulation to evaluate robot policies using handheld fisheye cameras.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on robotic policy simulation evaluation, not language model benchmarks.
Enhanced Detective: A Dual-Stage Proactive Defense Against Internal Poisoning Attacks in Financial Fraud Detection Using Federated Learning
The paper introduces a dual-stage robust aggregation defense against data and model poisoning attacks in federated financial fraud detection.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Studies poisoning defenses in FL, not LLM evaluation benchmarks.
Box-WAM: Box Trajectories as Compact State Representations for World Action Models
The paper proposes predicting 3D bounding box trajectories instead of dense video frames as compact representations for world action models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a policy modeling representation, not an LLM benchmark.
Towards Green AI: Evaluating Energy Efficiency for Quantized LLM Inference
The paper evaluates the energy efficiency, carbon intensity, and accuracy of ten post-training quantization methods across various language models and GPUs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on hardware energy profiling rather than LLM benchmark design.
TacitVLA: Reasoning Vision-Language-Action Models Without Reasoning Latency
The paper proposes a vision-language-action model where action execution avoids inference latency by decoupling from explicit reasoning output at runtime.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates a specific model architecture, not benchmarking LLMs.
Convex-Analytic View of Query Selection for Safety Verification of Markov Decision Processes
The paper presents a convex-analytic framework to select query directions for safety verification in Markov decision processes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on mathematical verification algorithms, not LLM evaluation benchmarks.
Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents
The paper analyzes the failure modes of agent memory reuse and evaluates certified memory update strategies when facts change.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents theoretical and empirical bounds on memory safety, not an LLM benchmark.
Reference Wording Shapes Retrieval of Robot Task Instructions
The paper investigates how indexed instruction wording affects the performance of lexical rankers for robot task retrieval in manipulation benchmarks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates lexical ranker wording sensitivity, not general LLM benchmarks.
FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching
The paper presents an efficient video super-resolution method using hybrid attention and reward-yield distribution matching distillation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a video generation method, not an LLM benchmark.
Chasing Label Shifters: A Change-Aware Framework for Dynamic Graph Node Classification
The paper analyzes why dynamic graph neural networks fail on evolving nodes and introduces a change-aware classification framework.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Investigates dynamic graph node classification rather than LLM evaluation benchmarks.
RAN-JEPA: An Action-Conditioned World Model for Energy-efficient Mobile Network Control
The paper introduces an action-conditioned world model that separates observation representation learning from intervention learning for mobile network energy control.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Evaluates a domain-specific network model, not general LLM benchmarks.
Taming Softmax at the Limits of Muon: A Unified Approach through Hilbert Geometry
The paper applies Hilbert geometry to constrain activation shifts in softmax layers for stable optimizer updates in language model heads.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents an optimization formulation, not an evaluation method or benchmark.
Revisiting the 16x Pretraining Compute Gap between Diffusion and Autoregressive Language Models
The paper re-evaluates the pretraining compute scaling laws between diffusion and autoregressive language models using modern diffusion training designs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on pretraining compute scaling laws, not general LLM evaluation benchmarks.
Morphology-aware deep learning predicts colorectal cancer survival from whole-slide images
The paper introduces a morphology-aware contrastive learning framework to predict five-year colorectal cancer survival from whole-slide pathology images.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a medical survival prediction model, not an LLM benchmark.
Verifier-Harness Co-Evolution for Training-Free Self-Improvement on Open-Ended Tasks
The paper proposes a training-free framework that co-evolves an executable verifier program and harness state to self-improve agents on open-ended tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on runtime self-improvement loops rather than general benchmark design.
OpenDepth: Repurposing Image Editing Priors for Robust Open-World Monocular Depth Estimation
The paper presents a monocular depth estimation method that uses image editing priors to improve geometric consistency under environmental perturbations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a depth estimation model, not an evaluation benchmark.
MAS-Gate: Unlocking Multi-Agent System Lifecycle via Node-Centric Quantification
The paper presents a unified node-centric framework to quantify and manage multi-agent system lifecycles across design, runtime, and post-hoc attribution.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on multi-agent execution optimization rather than model benchmarking.
RELAY: Selective Self-Distillation with Adaptive Hand-off for Rubric-Based Reinforcement Learning
The paper proposes a rubric-based reinforcement learning method combining selective teacher distillation with an adaptive hand-off to standard optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an RL training technique, not an evaluation or benchmarking method.
4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling
The paper introduces a 4D latent cache to reuse static and dynamic visual representations for efficient conditioning in video generation models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Presents a video generation architecture, not an evaluation benchmark.
The Tokens Strike Back: Safety-Aware Denoising with Directional Embedding-based Revision
Presents SADDER, an inference-time text diffusion safety framework using directional embedding signals to steer unsafe tokens toward benign distributions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a safety steering method, not an evaluation framework.
When Should Enterprise Policy Decisions Be Learned, and When Should They Be Reasoned?
Evaluates enterprise policy enforcement across structured JSON versus single-token outputs, measuring the impact of explicit reasoning on decision stability.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Investigates agent decision interfaces rather than establishing a general LLM benchmark.
DeltaTTG: Training Multi-Turn Agents with a Token-to-Go Progress Meter
Introduces DeltaTTG, a method using predicted remaining token count as a progress signal to allocate advantages in multi-turn reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an RL training algorithm, not an evaluation methodology or benchmark.
PrT-Flow: Probability-Tractable Flow Matching for Reinforcement Learning
Proposes PrT-Flow, an invertible flow matching method that enables exact action probability computation for reinforcement learning in robotics.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Introduces a continuous RL method rather than general model evaluation methods.
Encounter-Driven City-Scale Human Mobility Generation with Large Language Models
Introduces EncounterMob, an LLM-based framework that generates human mobility trajectories while preserving both individual routines and multi-person encounter patterns.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Focuses on human mobility modeling rather than LLM benchmarking standards.
Dynamic K-Head: Difficulty-Supervised Budget Selection for Continuous Latent Reasoning
Proposes Dynamic K-Head, a question-conditioned budget selector that sets continuous latent reasoning steps based on input difficulty.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes a dynamic budget selector rather than a new evaluation framework.
Stable Token-level Scheduling for Serverless LLM Inference
Proposes Token Window Pacing, a serverless scheduling framework that regulates request admissions at the token level to reduce inter-token latency.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:17
Not relevant
Proposes an inference scheduling algorithm, not an evaluation method or benchmark.
2,521–2,580 of 3,345← PreviousNext →