Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Neural Surrogate Modeling of Ultrasonic Wave Propagation in Heterogeneous Media
Combines Fourier neural operators with local-integral resampling in a U-Net to model high-frequency ultrasonic waves in heterogeneous media.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents surrogate models for ultrasonic wave simulation, not LLM evaluation.
Data-Adaptive Mahalanobis Metric Learning for Cross-Head Attention in Transformers
Generalizes multi-head attention by learning data-adaptive, full cross-head Mahalanobis metric matrices to capture inter-head feature interactions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes an attention variant for Transformers, unrelated to LLM evaluation or benchmarks.
CopRoute: Dependence-Aware Conformal Routing for Language Models
Proposes a conformal routing method that accounts for model failure dependencies to optimize multi-model query coverage under risk budgets.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies routing algorithms to minimize LLM inference calls, not evaluation benchmarks or metrics.
MHR-Router: Multimodal Heterogeneous Retrieval-Enhanced Adaptive Routing for VLM Inference
Develops a retrieval-enhanced routing framework that dispatches multimodal queries to specialized vision-language models based on local failure patterns.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes an adaptive query router for VLM inference, not an evaluation framework or benchmark.
Recovering Irreducible Three-Body Interactions with Lagrangian Neural Networks
Applies Lagrangian neural networks with targeted sampling to recover non-pairwise three-body dispersion interactions directly from trajectory data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies physics-informed neural networks for molecular physics, not LLM evaluation or benchmarks.
DAG Structure Learning with Node-Varying Heavy-Tailed Disturbances
Presents a DAG structure learning method that jointly estimates graph structure and node-varying heavy-tailed disturbance parameters.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Investigates causal DAG structure learning under heavy-tailed noise, not LLM benchmark evaluation.
MORAD: Reinforcement Learning with Multi-Objective Rewards for RNA Inverse Design
Introduces an online reinforcement learning framework optimizing multi-objective rewards across diverse target backbones for RNA inverse design.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Deals with reinforcement learning for RNA sequence design, not LLM evaluation or benchmarks.
Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization
Proposes stabilization modules to enable half-precision FP16 proximal policy optimization training on commodity GPUs without numerical divergence.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on numerical stabilization for half-precision PPO reinforcement learning, not LLM benchmarking.
Sustainable Cloud-Fog-Edge Systems for Smart Buildings: Algorithmic Adaptation under Memory Constraints and Dynamic Orchestration Strategies
Presents an edge-computing architecture using low-cost hardware and adaptive algorithms to enable autonomous data management in smart buildings.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers IoT and smart building edge computing systems, not LLM evaluation methodology.
JEPA-kMMVAE: CSI Prediction for Time-Varying Wireless Channels
Combines joint-embedding predictive architecture with a Markov variational autoencoder to predict wireless channel state information under noisy observations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on wireless channel state information prediction, completely unrelated to LLM evaluation.
SBNO : Schrödinger Bridge Neural Operator for the Forward and Inverse Problems under Missing Information
Introduces a Schrödinger bridge diffusion matching method to solve forward and inverse partial differential equation problems under sparse observations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies surrogate neural operators for PDEs, not LLM benchmarks or evaluation methods.
DuoRate: Two-Rate Per-Expert Precision Allocation for Mixture-of-Experts Serving
Allocates precision across MoE experts by separately handling resident storage footprint and active batch decode traffic via dynamic optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on precision allocation and serving efficiency for MoE, not LLM evaluation benchmarks.
PDE-PFN: Prior-Data Fitted Neural PDE Solver
Proposes a transformer solver that uses in-context learning trained on approximate solutions to predict partial differential equation fields.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
In-context PDE solver framework, not LLM evaluation or benchmark design.
AgentTune: A Unified Training Lifecycle for Tool-Using LLM Agents
Presents an open-source library that unifies training, evaluation, reinforcement learning, and distillation workflows for tool-using language model agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a broad framework for training and running agents, not an LLM benchmark or evaluation study.
Understanding Mamba-3 Through Oscillatory Dynamics
Analyzes Mamba-3's input-dependent state rotations as oscillatory dynamics to explain their utility for tracking states and long-context language modeling.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes recurrent sequence model dynamics, not LLM evaluation benchmarks or methodologies.
Hidden Data Challenges in Clinical Machine Learning
Identifies and evaluates temporal, semantic, and population preprocessing misalignments that cause data leakage and bias in clinical machine learning pipelines.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Audits clinical tabular preprocessing pipelines, not LLM evaluation or benchmark methodology.
EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning
Proposes a reinforcement learning framework with verifiable rewards and error grounding to align multimodal emotion descriptions with human preferences.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Method for training emotion preference models, not an LLM evaluation framework or benchmark study.
Opening the Black Box of Classifier-Free Guidance via Information Bottleneck
Analyzes classifier-free guidance in diffusion models through an information bottleneck framework to characterize when conditioning information is most effective.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes classifier-free guidance in diffusion, not LLM evaluation or benchmark validity.
BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning
Introduces a conjugate gradient solver for large-scale kernel ridge regression using sketched block preconditioning to improve memory efficiency and convergence.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Scalable kernel solver algorithm, not LLM evaluation or benchmark reliability.
PlacePulse: Learning Transferable Place Representations from Structural Geographic Data
Presents a geospatial foundation model that creates structural place embeddings from sociodemographic and business data across hexagonal spatial units.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a geospatial foundation model and benchmark, not an evaluation method for language models.
Model-free Bayesian Clustering and Multimodal Posterior Summarisation
Develops a model-free Bayesian clustering method using martingale posteriors and Wasserstein summarization to bypass explicit likelihoods and MCMC sampling.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Bayesian clustering methodology, not LLM evaluation frameworks or benchmark metrics.
Why Linear Models Can Still Work in a Complex and Changing World
Analyzes theoretically and empirically why linear models often out-predict complex nonlinear models under finite samples and environment distribution shifts.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical paper explaining linear model transferability, not LLM benchmark design or evaluation protocols.
Desertification Forecasting in Semi-Arid Regions: Using Deep Learning to Probe the Observability Limits of Land Degradation Dynamics
Uses a convolutional LSTM on satellite data to evaluate the predictability and observational limits of year-to-year land degradation dynamics.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Satellite land degradation forecasting study, not general LLM evaluation or benchmark design.
Accelerating Linear Bandits with Persistent Candidate Sets
Introduces an efficient linear bandit algorithm that maintains a small candidate set of actions to reduce per-round evaluation costs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical bandit algorithm acceleration, not LLM evaluation or benchmarking frameworks.
One Thing Leads to Another: The Essentials of Time Series Causal Discovery
Provides a comprehensive tutorial on time series causal discovery methods, covering underlying principles, evaluation techniques, and practical applications.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Tutorial on time series causal discovery methods, not LLM evaluation benchmarks or testing protocols.
Learning by Compression: Risk Estimates Attain the Law-of-Large-Numbers Rate
Proves that risk estimates derived from preferent compression schemes achieve standard law-of-large-numbers rates without excess logarithmic factors.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Statistical learning theory on risk bounds, not empirical LLM evaluation or benchmark frameworks.
Harmonic analysis and circuit approximation of Sobolev functions on quantum input spaces
Derives theoretical approximation rates for Sobolev functions on quantum state and gate spaces using harmonic analysis and finite-depth quantum circuits.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on quantum Sobolev function approximation, not LLM benchmarks or evaluation trustworthiness.
A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition
Introduces a learned primal-dual solver for nonlinear model predictive control that uses temporal decomposition to scale independently of the prediction horizon.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses learned optimization for nonlinear predictive control, not LLM benchmarks or evaluation methods.
FedPCD: Priority-Constrained Federated Aggregation
Proposes a federated optimization framework that preserves global aggregate objectives while applying minimal corrections to meet individual client performance constraints.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on federated optimization algorithms, not LLM evaluation methods or benchmark datasets.
Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers
Analyzes the discrete-time dynamical system of transformer self-attention, classifying its equilibria and showing consensus alignment with the value matrix's principal eigenvector.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of self-attention dynamical systems, not LLM evaluation benchmarks or methodologies.
Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models
Simulates transformer training loss spikes using quadratic models with heavy-tailed inputs and derives an adaptive optimizer hyperparameter schedule to prevent them.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies pre-training loss spike dynamics theoretically, not LLM benchmark design or evaluation trustworthiness.
Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data
Evaluates Transformer models trained with quantile loss on historical vessel position data to produce probabilistic ship trajectory forecasts.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Evaluates maritime vessel trajectory forecasting, not LLM evaluation or benchmarks.
Rationally Linearized MLPs
Linearizes multilayer perceptrons using low-degree rational approximations of activation functions to reduce inference costs across 3D models and language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on MLP linearization techniques, not benchmark creation or LLM evaluation.
Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment
Presents an online randomized TCP acknowledgment algorithm that provides simultaneous competitive ratio bounds and sublinear regret against the best expert.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Online algorithms paper for networking TCP ACK, unrelated to LLM benchmarks.
$L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression
Applies Monte Carlo Tree Search with generalized rollout policy adaptation to optimize out-of-sample feature selection for high-dimensional financial regression.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Deals with financial feature selection via search, not LLM benchmarks or evaluation.
Probabilistic Forecasting of Electric Vehicle Charging in a Time-varying Hierarchical Infrastructure
Combines hierarchical forecasting with conformal prediction under missing data to forecast electric vehicle charging demand with valid prediction intervals across evolving networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies conformal prediction for EV demand forecasting, not LLM evaluation or benchmarks.
Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
Investigates theoretical lower bounds for randomized linear minimization oracle optimization algorithms over strongly convex sets.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical optimization lower bounds paper, unrelated to LLM evaluation.
EchoTab: Learning Measurement-Grounded Representations for Echocardiographic Diagnosis through Tabular Reconstruction
Proposes a measurement-grounded representation framework using tabular tokens to link multi-view echocardiograms to clinical diagnostic tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes medical imaging representation learning, not LLM benchmarks or evaluation.
A small cognitive core explains human behavior at scale
Presents a cognitive architecture based on episodic memory hierarchies and context-dependent error updates to predict human choice behavior.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Cognitive psychology computational model of human choices, not an LLM evaluation benchmark.
CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope
Proposes an unconstrained parameterization and equivariant flow matching model for generating valid correlation matrices.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces a flow matching method for correlation matrices, not an LLM benchmark.
Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
Presents a cycle-consistent adversarial model enabling continuous sound pressure level adjustments for speech vocal intensity conversion.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers speech synthesis and vocal intensity conversion, not LLM evaluation or benchmarks.
Some remarks on the connection between generative diffusion and optimal transport
Analyzes theoretical connections between generative diffusion models, flow matching, and entropic optimal transport formulations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of diffusion and optimal transport, not LLM evaluation or benchmarks.
Kernel-based External Validity of Experimental Studies
Develops a kernel-based maximum mean discrepancy framework to formalize and estimate the external validity and replicability of experimental studies.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses theoretical statistical external validity using kernels, not LLM evaluation benchmarks.
JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation
Introduces a replay benchmark to evaluate robot motion smoothness and controller latency in vision-language-action manipulation pipelines.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Benchmark focuses on robotic motion quality in controllers, not LLM evaluation methods.
Private and Distributionally Robust Federated Multiclass Classification
Develops a differentially private and distributionally robust ADMM framework for multiclass classification across distributed client data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on federated classification algorithms, not LLM evaluation or benchmarks.
PANDA: Prior-guided Attentional Dual-path Architecture
Presents a dual-path architecture combining normalized attention and incidence priors for hypergraph message-passing neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents hypergraph neural network architecture, unrelated to LLM evaluation benchmarks.
Electron-Density-Informed Molecular Property Prediction Using Surrogate Functionals
Applies a surrogate functional framework incorporating ground-state electron density to improve molecular property prediction models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses chemical molecular property prediction, not LLM evaluation or benchmarks.
A Critical Look at Power Sampling when Test Time Sharpening LLMs
Examines sampling methods for test-time sharpening in language models and shows simple best-of-N approaches yield comparable gains.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies test-time sampling distributions for reasoning rather than developing evaluation benchmarks.
TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy
Introduces a benchmark evaluating tabular foundation models across point prediction, distributional calibration, and prediction interval efficiency.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Benchmark is specifically for tabular foundation models, not LLM evaluation or language benchmarks.
Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields
Proposes a scalable variational inference method using sparse autoregressive structures and normalizing flows for non-Gaussian spatial field models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on variational inference for spatial statistics, not LLM benchmarks or evaluation.
On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models
Compares seven calendar feature encoding techniques across four time series foundation models to evaluate impact on forecast accuracy.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Evaluates calendar feature encodings in time series models, not language model evaluation benchmarks.
VQIL: Visible Quantum Interference Learning for Perturbation Response Ranking on Graphs
Introduces a parameterized quantum-walk model optimized via backpropagation to rank network node responses to seed perturbations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a quantum walk method for graph ranking, not an LLM benchmark or evaluation.
Transformer-based In-Context Score Operator Learning for Diffusion Models
Proposes an in-context score operator framework allowing diffusion models to adapt to unseen target distributions without retraining.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents an in-context operator framework for diffusion models, not LLM benchmarking.
Towards Understanding the Training of GFlowNets: A Theoretical Perspective
Develops a theoretical framework linking training objective losses to sampling accuracy and finite-time convergence in Generative Flow Networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of GFlowNets convergence, not language model evaluation.
Machine Unlearning for Federated Socially Fair k-Means Clustering
Presents an exact machine unlearning method for federated socially fair k-means clustering using separate group-level local summaries.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Addresses machine unlearning in federated clustering, not language model evaluation.
SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark
Introduces a multi-mode urban mobility benchmark across Seoul to evaluate origin-destination travel demand forecasting models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Benchmark is for urban origin-destination traffic flow forecasting, not language model evaluation.
SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices
Presents a compressed latent world-action model enabling faster robotic manipulation inference on resource-constrained edge hardware.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a lightweight robotic policy model rather than an LLM evaluation benchmark.
Studying the Effects of Task Diversity Using Small Mathematical Worlds
Introduces two synthetic mathematical task datasets to study how task diversity affects model learning during pretraining.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Introduces synthetic math environments to analyze training dynamics, not LLM benchmark evaluation.
How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference?
Empirically evaluates the Bayesian posterior approximation quality and amortization errors of prior-data fitted networks across synthetic prior tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes Bayesian approximation error in Prior-Data Fitted Networks, not LLM benchmarks.
From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds
Introduces an information-theoretic framework using rate-distortion theory to establish computable lower bounds on feature reconstruction under DP-SGD.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on differential privacy reconstruction bounds rather than LLM evaluation or benchmarks.
2,941–3,000 of 3,345← PreviousNext →