Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Towards Resilience: Slice-Driven Orchestration of Mobile IoMT in 6G-Edge-Continuum The paper introduces an adaptive network-slicing orchestration framework for medical IoT applications operating across edge-computing infrastructure. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on network orchestration rather than LLM evaluation. | |
| The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow The paper demonstrates that internal activation states can forecast and block unauthorized actions and deceptive reports by language model agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on action forecasting and gating rather than benchmark methodology. | |
| Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows The paper evaluates small language models for text-to-SQL tasks and tests lightweight iterative retry workflows to improve query accuracy. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates existing benchmarks rather than creating new testing frameworks. | |
| StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions The paper introduces decision models that balance fast single-pass predictions with adaptive reasoning for uncertain cases using reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a model training framework, not an evaluation benchmark. | |
| Joint Embedding with Dynamic Integration network (JEDI-net) The paper proposes clustering observations by feature importance profiles to incorporate latent factor representations into deep learning models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes model architecture rather than LLM evaluation benchmarks. | |
| Do Theorem Provers Need Theorem-Proving Agents? mini-Lean-agent: A Coding-Agent Baseline for Lean The paper presents a minimal coding agent baseline for Lean theorem proving using standard bash tooling instead of specialized harnesses. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates existing benchmarks rather than proposing a new LLM test. | |
| Budgeted KV-Cache Repair for Evolving Contexts The paper proposes a budgeted KV-cache repair technique to restore model performance efficiently after deleting obsolete context tokens. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an inference acceleration method, not an evaluation benchmark. | |
| On the Statistical Mechanics of Attention The paper presents a statistical mechanics framework using modern Hopfield models to analyze inference reliability and phase transitions in Transformer attention. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents theoretical physics analysis rather than empirical evaluation benchmarks. | |
| MID: Mask-Image Distributional Divergence for Evaluating Medical Image Segmentation The paper introduces a distribution-level evaluation metric for medical image segmentation to assess prediction sets without requiring paired ground-truth masks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Addresses medical image segmentation metrics rather than LLM benchmarks. | |
| When Goals Leak Across Relationships: How Cached Goal Representations Shape Cross-Client Decisions The paper examines how shared KV caches cause language model agents to leak goals across competing clients, offering internal intervention techniques. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on representation analysis and intervention, not benchmark development. | |
| HASTE: Hierarchical and Attribute-aware Supervision for Generative Recommendation The paper proposes a hierarchical and attribute-aware supervision method to improve training efficiency and long-tail performance in generative recommendations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a training method rather than LLM evaluation benchmarks. | |
| What Makes a Latent Space Shared? Direct and Recoverable Compatibility in Motion VAEs The authors analyze compatibility across multi-schema latent spaces in motion models, showing shared representations require explicit paired data to align. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Analyzes representation compatibility rather than LLM benchmarks or evaluation. | |
| EPOCH: Coverage-Aware Evolution with Experiential Preference Optimization for LLM-based Automated Heuristic Design The authors propose an evolutionary framework that optimizes instance coverage and updates language model weights to discover complementary optimization heuristics. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces an optimization algorithm rather than an LLM evaluation benchmark. | |
| Mitigating Black-Box Score-Based Query Attacks via Gradient Confusion The paper introduces a test-time wrapper that distorts exposed output probabilities to defend black-box machine learning models from query-based adversarial attacks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on adversarial defense mechanics rather than LLM benchmark evaluation. | |
| Cross-Market Meta-Learning for Electricity Price Forecasting The authors introduce a topology-aware transformer meta-trained across multiple electricity markets to forecast day-ahead electricity prices for unseen grids. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Addresses energy time-series forecasting, not LLM evaluation. | |
| Learning to Play: Reinforcement Learning and Games The authors provide a comprehensive textbook covering reinforcement learning methods, game-playing algorithms, and key historical milestones. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Book on game-playing RL methods, not LLM evaluation or benchmarks. | |
| Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting The paper develops a sequential betting approach to reliably detect data distribution shifts in unstructured text and image streams over time. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on statistical drift testing rather than LLM capability benchmarking. | |
| Generalizable field of view extension for diffusion MRI via conditional flow matching The authors propose a conditional flow-matching generative model to extend the field of view in diffusion brain MRI scans across scanners. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on MRI image reconstruction, not LLM benchmark evaluation. | |
| Event-Centric Earthquake Monitoring with a Multi-Station Transformer The paper presents a multi-station transformer model that jointly detects phase arrivals, locations, magnitudes, and associations for earthquake monitoring. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on seismic signal processing, not LLM evaluation benchmarks. | |
| Cross-View Time-Frequency Diffusion for Extreme-Aware Time-Series Generation The authors introduce a time-frequency diffusion framework that improves the generation of rare extreme events in time-series data. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Does not evaluate language models or present an LLM benchmark. | |
| Agency as a New Organizing Abstraction for Computer Science The paper argues that software agency should be treated as a core organizing abstraction in computer science rather than merely an AI application. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Conceptual perspective paper; does not introduce or analyze LLM benchmarks. | |
| Bottlenecked semantic compression by representation reconstruction The authors propose a visual token compression framework that reduces computational costs by retaining only visual tokens with high reconstruction residuals. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Does not evaluate language models or present an LLM benchmark. | |
| Why Agentic Workflows Fail: A Taxonomy Derived from Literature and Empirical Data The paper presents a taxonomy that locates agent workflow failures across specific workflow stages and agent functional capabilities. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Provides a failure taxonomy rather than a model evaluation benchmark. | |
| ClearNav: Perception-Aligned Quadrotor Flight Using Differential-Physics The authors present a flight navigation policy for quadrotors that penalizes movement outside the camera view to avoid collisions in cluttered environments. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Does not benchmark or evaluate language models. | |
| On Making $\mathrm{SE}(2)$-Invariant Networks Optimal The paper develops a plug-and-play module for convolutional neural networks that provides optimal rotation and translation invariance based on invariant theory. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Does not address language model evaluation or benchmarks. | |
| Reinforcement Learning In Partially Verifiable Environments for Colon Cancer Treatment Planning The authors formulate colon cancer treatment planning as an interactive reinforcement learning task in settings where actions are only partially verifiable. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on RL formulation for oncology, not LLM benchmark evaluation. | |
| World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models The paper proposes using test-time training memory to maintain consistent long-horizon visual scenes in real-time camera-controlled video world models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a video generation model, not general LLM benchmark evaluation. | |
| SchemaWeaver: Accelerating On-Device Mobile Agentic AI via Schema-Guided Parallel LLM Decoding The authors present a parallel decoding method that speeds up on-device tool calling for language model agents without requiring model retraining. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a decoding optimization rather than an evaluation benchmark. | |
| The belief-action gap in language model agents The authors examine why language model agents fail by analyzing discrepancies between internal representations of state values and actual action choices. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on internal agent mechanics rather than general LLM evaluation benchmarks. | |
| An FPGA-Based Spiking Neural Network for Spatiotemporal Pattern Learning and Classification The authors design an FPGA implementation of spiking neural networks that performs both inference and training on-chip without backpropagation through time. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents hardware implementation, not an LLM benchmark. | |
| Assessing the Performance of AI Models in Misinformation Detection Using Predefined Social Noise Constructs The paper evaluates seven machine learning and graph models on detecting misinformation within social media noise from conflict-related tweets. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates misinformation classifiers, not language model evaluation benchmarks. | |
| REA: From Correct LLM Judgments to Safe Decision Delivery The authors introduce a framework to track safety model judgments through output parsing to prevent malformed responses from causing bad decisions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates guardrail execution pipelines, not general LLM benchmarks. | |
| VeriPIE: Checkable Query Plans and Evidence-Guided Selection for Text-to-SQL The paper presents a neurosymbolic framework combining query plan checks and candidate selection to improve text-to-SQL translation for financial governance. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates on text-to-SQL datasets, but primary contribution is a neurosymbolic verification framework. | |
| Foundation Models for Event Prediction Across Heterogeneous Event Logs The paper presents an in-context foundation model architecture for next-event prediction across diverse operational event logs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a model architecture for event prediction, not an LLM benchmark. | |
| YUBI-Real2Sim: 3DGS Scene Verification for Reliable Policy Evaluation The paper introduces a framework combining 3D Gaussian Splatting and physical simulation to evaluate robot policies using handheld fisheye cameras. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on robotic policy simulation evaluation, not language model benchmarks. | |
| Enhanced Detective: A Dual-Stage Proactive Defense Against Internal Poisoning Attacks in Financial Fraud Detection Using Federated Learning The paper introduces a dual-stage robust aggregation defense against data and model poisoning attacks in federated financial fraud detection. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Studies poisoning defenses in FL, not LLM evaluation benchmarks. | |
| Box-WAM: Box Trajectories as Compact State Representations for World Action Models The paper proposes predicting 3D bounding box trajectories instead of dense video frames as compact representations for world action models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a policy modeling representation, not an LLM benchmark. | |
| Towards Green AI: Evaluating Energy Efficiency for Quantized LLM Inference The paper evaluates the energy efficiency, carbon intensity, and accuracy of ten post-training quantization methods across various language models and GPUs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on hardware energy profiling rather than LLM benchmark design. | |
| TacitVLA: Reasoning Vision-Language-Action Models Without Reasoning Latency The paper proposes a vision-language-action model where action execution avoids inference latency by decoupling from explicit reasoning output at runtime. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates a specific model architecture, not benchmarking LLMs. | |
| Convex-Analytic View of Query Selection for Safety Verification of Markov Decision Processes The paper presents a convex-analytic framework to select query directions for safety verification in Markov decision processes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on mathematical verification algorithms, not LLM evaluation benchmarks. | |
| Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents The paper analyzes the failure modes of agent memory reuse and evaluates certified memory update strategies when facts change. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents theoretical and empirical bounds on memory safety, not an LLM benchmark. | |
| Reference Wording Shapes Retrieval of Robot Task Instructions The paper investigates how indexed instruction wording affects the performance of lexical rankers for robot task retrieval in manipulation benchmarks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates lexical ranker wording sensitivity, not general LLM benchmarks. | |
| FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching The paper presents an efficient video super-resolution method using hybrid attention and reward-yield distribution matching distillation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a video generation method, not an LLM benchmark. | |
| Chasing Label Shifters: A Change-Aware Framework for Dynamic Graph Node Classification The paper analyzes why dynamic graph neural networks fail on evolving nodes and introduces a change-aware classification framework. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Investigates dynamic graph node classification rather than LLM evaluation benchmarks. | |
| RAN-JEPA: An Action-Conditioned World Model for Energy-efficient Mobile Network Control The paper introduces an action-conditioned world model that separates observation representation learning from intervention learning for mobile network energy control. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Evaluates a domain-specific network model, not general LLM benchmarks. | |
| Taming Softmax at the Limits of Muon: A Unified Approach through Hilbert Geometry The paper applies Hilbert geometry to constrain activation shifts in softmax layers for stable optimizer updates in language model heads. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents an optimization formulation, not an evaluation method or benchmark. | |
| Revisiting the 16x Pretraining Compute Gap between Diffusion and Autoregressive Language Models The paper re-evaluates the pretraining compute scaling laws between diffusion and autoregressive language models using modern diffusion training designs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on pretraining compute scaling laws, not general LLM evaluation benchmarks. | |
| Morphology-aware deep learning predicts colorectal cancer survival from whole-slide images The paper introduces a morphology-aware contrastive learning framework to predict five-year colorectal cancer survival from whole-slide pathology images. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a medical survival prediction model, not an LLM benchmark. | |
| Verifier-Harness Co-Evolution for Training-Free Self-Improvement on Open-Ended Tasks The paper proposes a training-free framework that co-evolves an executable verifier program and harness state to self-improve agents on open-ended tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on runtime self-improvement loops rather than general benchmark design. | |
| OpenDepth: Repurposing Image Editing Priors for Robust Open-World Monocular Depth Estimation The paper presents a monocular depth estimation method that uses image editing priors to improve geometric consistency under environmental perturbations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a depth estimation model, not an evaluation benchmark. | |
| MAS-Gate: Unlocking Multi-Agent System Lifecycle via Node-Centric Quantification The paper presents a unified node-centric framework to quantify and manage multi-agent system lifecycles across design, runtime, and post-hoc attribution. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on multi-agent execution optimization rather than model benchmarking. | |
| RELAY: Selective Self-Distillation with Adaptive Hand-off for Rubric-Based Reinforcement Learning The paper proposes a rubric-based reinforcement learning method combining selective teacher distillation with an adaptive hand-off to standard optimization. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an RL training technique, not an evaluation or benchmarking method. | |
| 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling The paper introduces a 4D latent cache to reuse static and dynamic visual representations for efficient conditioning in video generation models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Presents a video generation architecture, not an evaluation benchmark. | |
| The Tokens Strike Back: Safety-Aware Denoising with Directional Embedding-based Revision Presents SADDER, an inference-time text diffusion safety framework using directional embedding signals to steer unsafe tokens toward benign distributions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a safety steering method, not an evaluation framework. | |
| When Should Enterprise Policy Decisions Be Learned, and When Should They Be Reasoned? Evaluates enterprise policy enforcement across structured JSON versus single-token outputs, measuring the impact of explicit reasoning on decision stability. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Investigates agent decision interfaces rather than establishing a general LLM benchmark. | |
| DeltaTTG: Training Multi-Turn Agents with a Token-to-Go Progress Meter Introduces DeltaTTG, a method using predicted remaining token count as a progress signal to allocate advantages in multi-turn reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an RL training algorithm, not an evaluation methodology or benchmark. | |
| PrT-Flow: Probability-Tractable Flow Matching for Reinforcement Learning Proposes PrT-Flow, an invertible flow matching method that enables exact action probability computation for reinforcement learning in robotics. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Introduces a continuous RL method rather than general model evaluation methods. | |
| Encounter-Driven City-Scale Human Mobility Generation with Large Language Models Introduces EncounterMob, an LLM-based framework that generates human mobility trajectories while preserving both individual routines and multi-person encounter patterns. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Focuses on human mobility modeling rather than LLM benchmarking standards. | |
| Dynamic K-Head: Difficulty-Supervised Budget Selection for Continuous Latent Reasoning Proposes Dynamic K-Head, a question-conditioned budget selector that sets continuous latent reasoning steps based on input difficulty. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes a dynamic budget selector rather than a new evaluation framework. | |
| Stable Token-level Scheduling for Serverless LLM Inference Proposes Token Window Pacing, a serverless scheduling framework that regulates request admissions at the token level to reduce inter-token latency. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | Not relevant Proposes an inference scheduling algorithm, not an evaluation method or benchmark. |
2,521–2,580 of 3,345← PreviousNext →