Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
RobustLDS: Learning linear dynamical systems under adversarial corruptions
Develops robust estimators and optimization algorithms to learn linear dynamical systems from trajectories corrupted by adversarial outliers.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses identification of dynamical systems, not LLM evaluation.
Cost-Aware Mixture-of-Experts Coordination for Model Markets
Proposes a market-level mixture-of-experts coordination framework using cost-aware gating and revenue allocation across heterogeneous model services.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Market coordination for mixture-of-experts, not LLM benchmarks.
Puffin: Probabilistic Learning of Spatial Detail From Coarse Observations
Presents a probabilistic framework to disaggregate coarse socioeconomic observations into fine spatial scales using satellite embeddings.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on spatial statistical disaggregation, not LLM benchmarking.
Market Impact Estimation via Causal Foundation Models
Introduces a continuous-time causal prior-data fitted network simulator to estimate market impact without confounding biases.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Deals with financial market simulation, not language model evaluation.
Efficient Learning of Survival Analysis Models Under Outcome-Dependent Truncation and Censoring
Provides theoretical guarantees for efficiently learning Cox survival analysis models using first-order optimization under outcome-dependent truncation and censoring.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Statistical survival analysis optimization, not LLM evaluation.
TACROSS: An Efficient and Low-Cost Scalable Human Touch System Across Heterogeneous Tactile Sensors for Dexterous Robot Learning
Develops a low-cost piezoresistive glove system that aligns human touch demonstrations with robot sensors via contact events.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a robotic tactile hardware and learning system, not LLM evaluation.
Score-Based Learning of Cluster DAGs from Interventions
Presents a score-based method to learn cluster causal directed acyclic graphs from interventional data under linear Gaussian assumptions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies causal graph structure learning, not LLM benchmarks.
Interval-valued SHAP in Tree-Based Models
Introduces an imprecise Dirichlet model method to calculate interval-valued Shapley values and analyze attribution robustness in tree-based models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on Shapley value estimation for tree models, not LLM evaluation.
Reliability-Aware Future Conditioning for Temporally Robust Robot Manipulation
Proposes a reliability-aware conditioning method that mitigates harmful temporal misalignments when using generated video futures for robot manipulation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on robust conditioning for manipulation, not LLM benchmarks.
CAPABLE: Capability-Aware Policy Adaptation via Behavioral Latent Encoding
Introduces an adaptation framework for frozen vision-language-action policies using residual reinforcement learning and online capability inference during joint faults.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a policy adaptation framework, not LLM evaluation.
Efficient quadratic entropy with distance sketches
Presents scalable methods using distance sketches and random feature embeddings to efficiently approximate quadratic entropy across large distributions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Approximates quadratic entropy for distributions, not LLM benchmarking.
Example-driven Parametrisations for Bayesian Shape Optimisation
Learns linear shape parameterisations from past designs using PCA to improve sample efficiency in Bayesian shape optimisation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses engineering shape optimization, not LLM evaluation.
Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits
Analyzes test-time compute strategies, including parameter adaptation and prediction aggregation, to improve predictions in tabular foundation models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies test-time compute on tabular foundation models, not evaluating LLMs.
Ghost tasking for parametrized Gaussian Processes solving linear differential equations
The paper proposes ghost tasking, adding auxiliary tasks to enable parametrized Gaussian processes for non-parametrizable linear differential equations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on Gaussian processes for differential equations, not LLM evaluation.
CausalDreamer: Learning Predictive World Models with Latent Disentanglement
The paper introduces CausalDreamer, disentangling world model latent representations along controllability and reward relevance dimensions for control.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a world model architecture for control, not LLM evaluation frameworks.
Efficient and Generalizable Archetypal Analysis for Discrete Data
The paper develops an active-set likelihood framework for archetypal analysis on discrete binary, count, and categorical data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on statistical archetypal analysis, not benchmarking or evaluating LLMs.
Diffusion Removes Langevin's Conditioning Dependence: A Sharp Gaussian Analysis
The paper analyzes Gaussian diffusion sampling to show how time-dependent trajectories eliminate condition number dependence seen in Langevin dynamics.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of diffusion sampling convergence, not LLM evaluation or benchmarks.
Enriched Holomorphic Neural Networks for 2D and 3D Laplace Problems
The paper combines holomorphic neural networks with singular basis functions to solve 2D and 3D Laplace boundary-value problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Solves PDE boundary value problems, not evaluating or benchmarking language models.
Exploiting Gradients in Bayesian Inference of Expensive Simulators
The paper proposes using simulator output gradients within Bayesian active learning to infer input parameters of expensive differential equation simulators.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on gradient-assisted Bayesian inference for simulators, not LLM evaluation.
Differentiable Systematic Resampling for Variational Sequential Monte Carlo
The paper introduces Differentiable Systematic Resampling, a smooth relaxation enabling gradient-based optimization in variational sequential Monte Carlo.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a differentiable resampling algorithm for particle filters, not LLM evaluation.
SCORE: Spectral Correlation Estimation for Multivariate Gaussians
The paper introduces SCORE, an efficient spectral framework for approximating and estimating high-dimensional structured Gaussian covariance matrices.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents covariance matrix approximation methods for multivariate Gaussians, not LLM benchmarks.
Credal Machine Learning for Risk-Averse Decision Making
The paper proposes a credal machine learning framework that models epistemic uncertainty with probability distribution sets for risk-averse decision-making.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes credal sets for risk-averse ML decision making, not LLM evaluation.
A structure-preserving neural density functional for the ions of a polymer electrolyte
The paper develops a neural density functional preserving physical symmetries to model ion correlations in inhomogeneous polymer electrolytes.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes neural density functionals for physical polymer electrolytes, not LLM evaluation.
Large-Scale Benchmarking of Quantum Neural Network Configurations for Financial Time Series Forecasting
The paper evaluates 1,368 quantum neural network configurations on financial time series forecasting using spot exchange rate data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Evaluates quantum neural networks on financial forecasting, not LLMs or language benchmarks.
Bayesian Optimisation under State-Preservation Constraints
The paper proposes a Bayesian optimization approach that uses linear response approximations to maintain state-preservation constraints in PDE systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers PDE-constrained Bayesian optimization for engineering, not LLM evaluation.
Toward Optimal Regret in Adversarial MDPs with Stochastic Hard Constraints
The paper introduces MA-OPS to achieve optimal regret in adversarial Markov decision processes subject to stochastic hard constraints.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of constrained Markov decision processes, not LLM evaluation.
Is Real-World Training Data Necessary for Generalist Graph Anomaly Detection?
The paper investigates synthetic graph generation and introduces TS-GGAD to train generalist graph anomaly detection models without real-world training graphs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on graph neural networks and graph anomaly detection, not LLM evaluation.
Quickest Change Detection with Diffusion-Integrated Scores
The paper proposes DI-SCUSUM, a training-free quickest change detection method using diffusion-smoothed empirical score differences.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a statistical quickest change detection method, not LLM evaluation.
ISBO: Scalable Spatio-Temporal Bayesian Optimization with Log Gaussian Cox Process Models via the INLA-SPDE Approach
The paper proposes ISBO, combining log Gaussian Cox processes with the INLA-SPDE approach for scalable spatio-temporal Bayesian optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents Bayesian optimization for spatio-temporal data, not LLM evaluation.
Training on the Future: A Delay-Aware Audit of Test-Time Adaptation for Time-Series Forecasting
The paper audits test-time adaptation methods for time-series forecasting under realistic, delay-aware conditions to evaluate actual streaming performance.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Audits test-time adaptation for time-series forecasting, not LLMs or language benchmarks.
RIFT: Relative Isolation From Trees For Anomaly Detection
The paper introduces RIFT, a deterministic, parameter-free anomaly detection algorithm based on minimum spanning trees inspired by Isolation Forests.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a tree-based anomaly detection algorithm, not LLM benchmarks or evaluation.
AdaptLSTM: Efficient Adaptive Online Learning for Cloud Workload Forecasting under Distribution Drift
The paper presents AdaptLSTM, an adaptive online learning method that selectively updates cloud workload forecasts upon detecting distribution drift.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on time-series online learning for cloud workloads, not LLM evaluation.
Spatial Pattern Formation from Multi-Agent Learning in Public Goods Dilemmas
The paper examines how multi-agent Q-learning movement policies generate spatial clustering and traveling bands in spatial public goods games.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies multi-agent reinforcement learning dynamics, not LLM evaluation.
Composite Online-to-Nonconvex Conversion with Optimal Oracle Complexity
The paper develops an online-to-nonconvex conversion framework for stochastic nonsmooth nonconvex composite optimization achieving optimal oracle complexity bounds.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
A theoretical paper on nonsmooth nonconvex optimization, not LLM benchmarks.
asdex: Automatic Sparse Differentiation in JAX
The paper presents asdex, an automatic sparse differentiation library in JAX that uses graph coloring to compute sparse Jacobians efficiently.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a sparse automatic differentiation toolkit in JAX, not LLM evaluation.
Ambient Discrete Diffusion: Using the Wrong Data at the Right Time for Data Efficient Learning
The paper introduces RefineMix to train discrete diffusion models under data scarcity using out-of-distribution data at chosen diffusion timesteps.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a diffusion training framework for scientific data, not LLM evaluation benchmarks.
SplitJEPA: Learning Invariant and Variant Latent Worlds without Reconstruction
The paper presents SplitJEPA, learning invariant and variant latent world state representations directly without using reconstruction objectives.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on representation learning via JEPA, not evaluating or benchmarking language models.
Subspace Uncertainty and Sharp Sampling Thresholds on the Boolean Cube
This paper derives sharp sample complexity thresholds for Gaussian regression over bounded-degree polynomial subspaces on the Boolean cube.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes theoretical Gaussian regression on the Boolean cube, not LLM evaluation.
Closing the Horizon Gap in Policy Optimization for Adversarial MDPs
This paper establishes tighter regret bounds for adversarial Markov decision processes by incorporating regularized Q-functions into policy optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies theoretical regret bounds in MDPs rather than LLM evaluation.
Bilevel optimization for data-driven learning of Koopman embeddings using kernel-based autoencoders
This paper uses bilevel optimization and kernel autoencoders to learn finite-dimensional Koopman operator embeddings from nonlinear dynamical data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies dynamical systems and Koopman embeddings, not language model evaluation.
Marformer: A Transformer for Predicting Missing Data Distributions
This paper presents a transformer architecture that predicts conditional marginal distributions for missing data in a single forward pass.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a tabular data model for missing values rather than LLM evaluation.
Prospective Prediction of OOD Degradation from Source-Side Training Dynamics
This paper analyzes source-side training dynamics to prospectively detect out-of-distribution performance degradation before evaluation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on predicting OOD failure from training dynamics rather than LLM benchmark evaluation.
Learning Kilometer-Scale Weather Prediction with Global-Regional Alignment
This paper introduces a regional weather forecasting framework that aligns pretrained global model guidance with high-resolution regional representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Applies models to weather prediction rather than LLM evaluation or benchmarks.
A Unified Bellman Operator for Safety-Critical Reinforcement Learning
This paper develops a unified Bellman operator to optimize task performance and enforce constraints within safety-critical reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a safe RL theoretical operator rather than LLM benchmarking.
Transformer-Based Masked Diffusion Models Provably Learn Distributions with Latent Structure
This paper provides statistical sample complexity guarantees for transformer-based masked diffusion models learning distributions with latent tree structures.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents theoretical sample complexity bounds for masked diffusion, not LLM evaluation.
Toward Joint Optimization of Circuit Depth and Training Data Size in Adaptively Grown Quantum Classifiers
This paper investigates the relationship between circuit depth, training dataset size, and generalization bounds in adaptively grown quantum classifiers.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies quantum circuit generalization on MNIST rather than LLM evaluation.
FAITH: Feasibility-Aware Safety-Filtered RL for High-Dimensional Systems
This paper presents a feasibility-aware safety filter that amortizes minimal-intervention constraints using a feedforward neural network in reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a safe RL framework rather than LLM benchmarking or evaluation.
VioLA: Learning Generalist Humanoid Control Policies from Human Data
This paper trains a generalist humanoid policy by predicting body and hand motion latents mapped from human demonstration data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Develops a humanoid control policy without focusing on LLM evaluation or benchmarks.
Density Ratio Estimation with Stein Displacement Fields
This paper estimates density ratios by parameterizing distribution shift as a displacement field using the Stein operator.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Investigates mathematical density ratio estimation, not language model evaluation.
Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization
This paper redesigns 4-bit AdamW optimizer-state quantization by performing stochastic rounding directly within preconditioner space.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies optimizer-state quantization rather than language model evaluation methods.
A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Control
This paper analyzes data sampling distributions across parallel simulations to improve exploration efficiency in reinforcement learning for robot control.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses simulation sample efficiency in RL, not language model evaluation.
CSF: Contextual Safety Filtering for Motion Generators
This paper introduces a training-free safety filter that evaluates scene context to constrain generated humanoid motion trajectories.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a control safety filter for robot motion, not LLM benchmark evaluation.
Sample-Adaptive Zeroth-Order Post-Training
This paper proposes a sample-adaptive zeroth-order optimization method that estimates sample importance online to accelerate large language model fine-tuning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Develops a post-training optimization method without focusing on LLM evaluation.
An all-transistor physical-learning transformer can be trained to perform in-context learning
This paper designs and simulates an all-transistor physical circuit using sub-threshold MOSFETs to run transformer attention and in-context learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on hardware-level physical learning circuits rather than LLM benchmarks or evaluation.
DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models
This paper proposes a reward aggregation method to stabilize and scale reinforcement learning fine-tuning for diffusion models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Develops an RL algorithm for diffusion models without proposing LLM evaluation frameworks.
Realism VS Accuracy: Event Sequence Forecasting from a Generative Modeling Perspective
This paper introduces a benchmark and a diffusion aggregation algorithm to evaluate and balance accuracy and realism in event sequence forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Evaluates event sequence forecasting models, not large language models or LLM evaluation.
STAPLE: Static Sparse Upcycling of Pretrained Checkpoints via Embedding Modules
This paper presents a method for upcycling pretrained language models into sparse architectures using token-indexed embeddings in residual pathways.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Evaluates on standard benchmarks but does not introduce or study LLM evaluation methods.
SynAct: Synergistic Active Feedback Learning for LLM Agents
This paper proposes an active learning framework that selectively requests expert feedback at high-value decision steps during LLM agent workflows.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on active learning algorithms for agent workflows, not LLM benchmark evaluation.
Data-driven Optimal Sensor Placement for Aerosol Monitoring in the UK
This paper applies a convolutional Gaussian neural process and genetic optimization to select optimal aerosol monitoring sensor locations across the UK.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers sensor placement for atmospheric monitoring, not LLM evaluation.
Amortised Inference through One-Step Implicit Sampling
This paper introduces a one-step implicit sampler using short-time MCMC dynamics to enable efficient amortized inference for Bayesian posteriors.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses Bayesian posterior sampling techniques, not LLM evaluation.
2,821–2,880 of 3,345← PreviousNext →