Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
TRACER: Trace-Regularized Training Against Indirect Prompt Injection
The paper introduces an adversarial training framework that hardens models against indirect prompt injection across retrieval and tool interaction channels.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on prompt injection defense training, not general benchmarking.
Student Copula Markov Networks
The paper extends undirected graphical models to non-Gaussian data using copula densities and provides an estimation algorithm.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical copula graphical model paper, not an LLM benchmark.
Online Tokenization with Optimal Delay in Linear Time
The paper introduces an online tokenization algorithm that processes text streams in linear time with minimal algorithmic delay.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Presents a tokenization algorithm, not an LLM benchmark.
Towards Training and Inference of Graph Neural Networks in Graph Databases
The paper shows how graph databases can execute graph neural network sampling, retrieval, and inference directly without separate in-memory pipelines.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on GNN database systems, not LLM evaluation benchmarks.
Demystifying On-Policy Distillation: Where Does the Teacher's Advantage Live?
The paper examines teacher interventions along student generation paths to identify how teacher guidance drives performance gains in on-policy distillation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Investigates distillation mechanics rather than LLM benchmarking suites.
Learning in Strategic Queuing with Geometric Recharge: From Bandits to Systems
The paper analyzes packet routing throughput when selfish queue agents use no-regret learning algorithms to select buffered servers.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Analyzes multi-agent queuing theory, not LLM benchmarking.
Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent
The paper proposes a Bayesian full waveform inversion framework that uses learned diffusion models as regularizers for geological reconstruction.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Pertains to geophysics waveform inversion, not LLM evaluation.
Adaptive Computation with Conformal Certification
The paper develops an adaptive computation framework offering conformal uncertainty guarantees for processing large scientific and medical imagery efficiently.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Deals with conformal risk certification for imaging, not LLM benchmarks.
FireGraphNet: Sub-daily wildfire spread prediction with directed graph neural networks
The paper proposes a directed graph neural network approach to forecast twelve-hour wildfire spread using spatial and environmental attributes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Wildfire spread prediction with GNNs, not LLM evaluation.
Spectral-MoE: Heterogeneous Per-Layer Expert Utilization in Dense-to-MoE Conversion
The paper introduces a method to convert dense models into mixture-of-experts by dynamically allocating different numbers of active experts across layers.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on MoE model architecture optimization, not LLM benchmarking.
From Detection To Anticipation: Continuous Onset Forecasting For Stuttered Speech
The paper develops a continuous forecasting method using speech representations to anticipate stuttering events shortly before they occur.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Studies speech dysfluency forecasting, not LLM benchmark evaluation.
LLMs program using Reusable and Composable Abstract Representations
The paper demonstrates that language models use modular abstract representations to generalize code generation across different programming languages and strategies.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on mechanistic representation analysis rather than LLM benchmarking methods.
Multi-Sensitive Distributional Fairness: Joint Wasserstein Audits and Shapley Allocation
The paper presents a framework using Wasserstein geometry and Shapley values to audit and decompose intersectional fairness disparities across multiple attributes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on statistical fairness metrics rather than LLM evaluation benchmarks.
Beyond Time Induction: Structured Conditional Neural Solvers for Parametric Stochastic-Volatility Pricing
The paper introduces a neural solver architecture to accurately compute solutions and sensitivities for parametric stochastic volatility partial differential equations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Applies neural solvers to stochastic PDEs, not LLM evaluation.
Outcome-Routed Distillation and Reinforcement Learning for Diffusion Language Models
The paper presents an outcome-routed distillation and reinforcement learning method tailored for training mixture-of-experts diffusion language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Develops a distillation training pipeline, not an evaluation framework.
Exact Scaling Laws for a Random-Features Bigram Model
The paper derives theoretical scaling laws for prediction regret in a capacity-constrained bigram model with power-law token frequencies.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical derivation of scaling laws, not empirical benchmark evaluation.
Verifier-Grounded Agentic RL for Provably Correct Code
The paper introduces an agentic reinforcement learning approach that uses formal program verifier diagnostics as intermediate rewards to produce verified code.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Proposes an RL training environment rather than LLM benchmarking methods.
Historical-Feature Residual Adaptation for Sequential Screening
The paper proposes an acquisition-time residual adaptation method that uses historical features to improve hit rates in sequential screening.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Deals with sequential screening policies, not LLM benchmark evaluation.
Why don't Graph Transformers attend to the same token?
The paper examines why molecular graph transformers avoid attention sink patterns seen in language models and highlights attention design impacts.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Analyzes internal attention mechanisms in graph transformers, not benchmark evaluation.
BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments
The paper introduces a framework to translate and decompose clinical measurement records across heterogeneous assessment systems within predefined error tolerances.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on clinical measurement harmonization, not LLM evaluation.
Dynamic Graph World Modelling: Learning Future Dynamics from Temporal Context
The paper presents a dynamic graph framework to jointly forecast evolving node and relation representations from historical graph contexts.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Proposes a dynamic graph architecture, not LLM evaluation benchmarks.
RA$^2$: Retain-Anchored Attraction Preserves Forget-Adjacent Utility in LLM Unlearning
The paper proposes a latent-space unlearning method that preserves model performance on benign tasks conceptually adjacent to forgotten domains.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on machine unlearning methodology, not LLM evaluation frameworks or benchmarks.
Fully sequential Gaussian process regression for preference learning
The paper presents a sequential Gaussian process method and sampling policy for continuous optimization based on pairwise preference comparisons.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Sequential Gaussian process regression theory, not LLM evaluation.
Selective Next-Location Prediction with MetaModelSelect: A Lightweight Post-Hoc Confidence Metamodel
The paper applies a lightweight post-hoc classifier to evaluate confidence and filter out incorrect next-location predictions from recurrent models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Post-hoc confidence metamodel for cellular next-location prediction, not LLM evaluation.
ActMOF: Mapping Reticular Synthesis through Active Learning
The paper introduces an experimental benchmark to evaluate active learning and Bayesian optimization strategies for synthesizing metal-organic frameworks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Benchmark for chemical reticular synthesis active learning, not LLM evaluation.
W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition
The paper introduces a self-supervised wavelet predictive architecture to extract multiscale motion features from wearable activity sensors.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Wearable sensor activity recognition, not language model evaluation.
Comprehensive Comparisons of Reinforcement Learning Algorithms in Autonomous Driving
The paper benchmarks four reinforcement learning algorithms on safety, data efficiency, and stability for autonomous vehicle intersection navigation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Benchmarking autonomous vehicle RL algorithms, not language model evaluation.
Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents
The paper introduces a progress-aware distillation method to prevent small language model agents from stalling in repetitive loops during long tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on distillation training methods rather than new LLM evaluation benchmarks.
Large-Step Last-Iterate Convergence of Random-Reshuffling Stochastic Gradient Descent
The paper establishes theoretical last-iterate convergence rates for random-reshuffling stochastic gradient descent using larger stepsizes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical optimization theory for SGD, not LLM evaluation.
State-Matched Sequence Conformal Prediction
The paper proposes a sequential conformal prediction algorithm that groups calibration scores by state similarity rather than pure temporal recency.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on conformal prediction theory, not LLM benchmarking.
Digital Self-Interference Cancellation for In-Band Full-Duplex Systems Based on Transformer Neural Operators
The paper applies transformer neural operators to model interference channels and cancel digital self-interference in full-duplex radio systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Radio frequency signal cancellation, not language model evaluation.
SKG: A Law-Induced Engine from Inference to Induction
The paper presents a mathematical framework unifying symplectic geometry, kernel methods, and physical conservation laws for physics-constrained learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical physics-informed gradient reasoning engine, not LLM benchmarks.
CktHGVAE: A Symmetric Design/State Heterogeneous Graph Variational Autoencoder for Transistor-level Analog/Mixed-signal Circuit Design and Analysis
The paper introduces a heterogeneous graph variational autoencoder to model design and state variables jointly for analog circuit analysis.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Heterogeneous graph VAEs for analog circuits, not LLM evaluation.
High-Probability Regret Bounds for Feel-Good Thompson Sampling
The paper establishes theoretical high-probability regret bounds for feel-good Thompson sampling algorithms in contextual bandit problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Contextual bandit regret theory, not language model evaluation or benchmarks.
HankelKANet: Lightweight Path Loss Estimation via Physics-Inspired Hankel Convolution
The paper proposes a neural network using physics-inspired Hankel convolution kernels for lightweight path loss estimation in wireless networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on wireless path loss estimation, not LLM evaluation.
Two-stage Residual Learning for Modelling Strength-Informed Optimisation of Thermal Systems
The paper introduces a two-stage residual learning framework to detect local inaccuracies and guide the optimization of thermal systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Surrogate modeling for thermal systems, not LLM evaluation or benchmarks.
Noisy-Label Calibration with Multiple Unreliable Labels
The paper develops methods to evaluate and recalibrate binary predictors using noisy, multi-annotator labels without requiring clean ground truth.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Addresses general binary classification calibration under noisy labels, not LLM benchmarking.
Test-Time Forecasting: Recurrent Depth Enables In-Context Dynamics Prediction
The paper uses recurrent gradient descent iterations during test time to enable foundation models to forecast unseen dynamical systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on dynamical systems forecasting architectures, not LLM evaluation.
Geometric Kernel Diversity: An Axiomatic Diversity Measure in Euclidean Space
The paper introduces a continuous, monotonic geometric kernel measure and algorithms to efficiently compute diversity over Euclidean points.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Computational geometry for axiomatic diversity measures, not language model evaluation.
On Inherent Privacy of Posterior Sampling: A Unified Rényi-Divergence Framework
The paper develops a theoretical Rényi-divergence framework to measure inherent differential privacy guarantees obtained directly from Bayesian posterior sampling.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Addresses theoretical differential privacy bounds, not LLM evaluation frameworks.
Projected Wasserstein-Fisher-Rao Flows for Hawkes Background-Intensity Estimation
The paper proposes a variational method using Wasserstein-Fisher-Rao geometry to estimate the background intensity of Hawkes processes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical statistics for Hawkes processes, not LLM benchmarking or evaluation.
InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design
The paper introduces a model for de novo protein sequence generation guided by natural language instructions and biological context encoders.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on computational biology and protein sequence design, not LLM evaluation benchmarks.
Risk-Controlled DFT Selection for Machine-Learned Interatomic Potentials
The paper applies conformal risk control to decide when to trust machine-learned interatomic potentials versus running expensive physics calculations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Covers conformal risk control for interatomic potentials, not LLMs.
Synthetic reaction data from transformation rules for graph-to-sequence pretraining in biodegradation pathway prediction
The paper develops a graph-to-sequence pretraining framework using rule-generated synthetic reactions to predict chemical biodegradation pathways.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on biodegradation chemical pathways, not LLM benchmarks.
On Global Joint Lower Bounds in Zeroth-Order Nonconvex Optimization
The paper proves theoretical joint lower bounds on oracle complexity for zeroth-order nonconvex stochastic optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical nonconvex optimization bounds, not LLM benchmarks.
Annealed Lévy Diffusion via Gaussian Surrogate Reverse Dynamics
The paper proposes a generative diffusion framework that anneals heavy-tailed noise into Gaussian noise to combine exploration with stable refinement.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Studies diffusion sampling mathematics, not LLM evaluation benchmarks.
ReGRA: Residual-Gradient Adaptation for Complementary Low-Rank Fine-Tuning
The paper introduces a two-stage low-rank fine-tuning method that uses residual gradients to add complementary adaptation directions without expanding the rank.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Introduces a fine-tuning method, not a benchmarking suite.
TIMERSI: Towards Self-Improved Agentic Deployment for Time-Series Foundation Models
The paper presents an agentic system that iteratively writes and adjusts forecasting pipelines around frozen time-series models to improve predictions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on automated time-series pipelines, not LLM evaluation benchmarks.
CAST: History-Adaptive Spectral Clipping for LLM Pretraining
Introduces an adaptive spectral gradient clipping method to stabilize and accelerate large language model pretraining.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Proposes a pretraining gradient clipping optimizer, not evaluation.
Learning to Compute Is Not Learning to Retain or Reuse in Looped Transformers
Investigates why looped transformers fail to retain or reuse earlier correct intermediate states when extended past training depth.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Investigates recurrent transformer mechanics, not LLM evaluation benchmarks.
When Does the Dependency Graph Help Code-to-Architecture Mapping?
Evaluates whether dependency graphs improve automated mapping between source code files and system architectures.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Studies software dependency mapping rather than LLM evaluation benchmarks.
From Global to Tail Convergence: Dynamics of $α$-Stable Score-Based Generative Models
Provides theoretical convergence bounds for score-based generative models driven by heavy-tailed stable processes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical analysis of score-based models, not LLM benchmarking.
SNACK: A Sequential Notation Framework for Probabilistic Graph Generation
Proposes a sequential string notation to represent and generate valid graphs using standard sequence models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on graph generation notation, not LLM benchmarks.
Learning Who Benefits Most: Multi-Treatment Causal Ranking for Population Health Stratification
Formulates clinical population health stratification as a multi-treatment causal ranking problem to prioritize interventions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Healthcare causal ranking framework, not LLM benchmark evaluation.
Reinforcement Learning via Advantage Guidance
Uses supervised advantage conditioning to train reinforcement learning policies with improved stability.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Presents a reinforcement learning algorithm, not LLM benchmarks.
Asymptotically Exact Negative Guidance of Diffusion Models via Positive-Unlabeled Learning
Applies positive-unlabeled learning to establish mathematically exact negative guidance in diffusion generative models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Covers negative guidance in diffusion models, not LLM evaluation.
Efficient contextual partial monitoring with general function approximation
Presents an efficient regression-based algorithm for contextual partial monitoring games with side information.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical bandit and game theory paper, not LLM evaluation.
Calibration and Risk-Budgeted Decisions with System One Models
Studies statistical calibration techniques to bound risk when fast language models make automated decisions under uncertainty.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on decision calibration and risk budgeting rather than benchmarks.
When Does Depth Help? Understanding Layerwise Inference in Tabular Foundation Models
Analyzes layerwise inference across tabular foundation models to understand how depth and intermediate representations affect predictions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Analyzes internal representations of tabular models, not LLM benchmarking.
JointServe: Serving Multi-Model Agents on Memory-Constrained GPUs
Presents a serving system that dynamically manages GPU memory and prefetches weights for multi-model agent workflows.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on memory serving architecture rather than LLM evaluation benchmarks.
1,081–1,140 of 3,345← PreviousNext →