Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Neural Surrogate Modeling of Ultrasonic Wave Propagation in Heterogeneous Media Combines Fourier neural operators with local-integral resampling in a U-Net to model high-frequency ultrasonic waves in heterogeneous media. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents surrogate models for ultrasonic wave simulation, not LLM evaluation. | |
| Data-Adaptive Mahalanobis Metric Learning for Cross-Head Attention in Transformers Generalizes multi-head attention by learning data-adaptive, full cross-head Mahalanobis metric matrices to capture inter-head feature interactions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes an attention variant for Transformers, unrelated to LLM evaluation or benchmarks. | |
| CopRoute: Dependence-Aware Conformal Routing for Language Models Proposes a conformal routing method that accounts for model failure dependencies to optimize multi-model query coverage under risk budgets. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies routing algorithms to minimize LLM inference calls, not evaluation benchmarks or metrics. | |
| MHR-Router: Multimodal Heterogeneous Retrieval-Enhanced Adaptive Routing for VLM Inference Develops a retrieval-enhanced routing framework that dispatches multimodal queries to specialized vision-language models based on local failure patterns. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes an adaptive query router for VLM inference, not an evaluation framework or benchmark. | |
| Recovering Irreducible Three-Body Interactions with Lagrangian Neural Networks Applies Lagrangian neural networks with targeted sampling to recover non-pairwise three-body dispersion interactions directly from trajectory data. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies physics-informed neural networks for molecular physics, not LLM evaluation or benchmarks. | |
| DAG Structure Learning with Node-Varying Heavy-Tailed Disturbances Presents a DAG structure learning method that jointly estimates graph structure and node-varying heavy-tailed disturbance parameters. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Investigates causal DAG structure learning under heavy-tailed noise, not LLM benchmark evaluation. | |
| MORAD: Reinforcement Learning with Multi-Objective Rewards for RNA Inverse Design Introduces an online reinforcement learning framework optimizing multi-objective rewards across diverse target backbones for RNA inverse design. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Deals with reinforcement learning for RNA sequence design, not LLM evaluation or benchmarks. | |
| Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization Proposes stabilization modules to enable half-precision FP16 proximal policy optimization training on commodity GPUs without numerical divergence. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on numerical stabilization for half-precision PPO reinforcement learning, not LLM benchmarking. | |
| Sustainable Cloud-Fog-Edge Systems for Smart Buildings: Algorithmic Adaptation under Memory Constraints and Dynamic Orchestration Strategies Presents an edge-computing architecture using low-cost hardware and adaptive algorithms to enable autonomous data management in smart buildings. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Covers IoT and smart building edge computing systems, not LLM evaluation methodology. | |
| JEPA-kMMVAE: CSI Prediction for Time-Varying Wireless Channels Combines joint-embedding predictive architecture with a Markov variational autoencoder to predict wireless channel state information under noisy observations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on wireless channel state information prediction, completely unrelated to LLM evaluation. | |
| SBNO : Schrödinger Bridge Neural Operator for the Forward and Inverse Problems under Missing Information Introduces a Schrödinger bridge diffusion matching method to solve forward and inverse partial differential equation problems under sparse observations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies surrogate neural operators for PDEs, not LLM benchmarks or evaluation methods. | |
| DuoRate: Two-Rate Per-Expert Precision Allocation for Mixture-of-Experts Serving Allocates precision across MoE experts by separately handling resident storage footprint and active batch decode traffic via dynamic optimization. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on precision allocation and serving efficiency for MoE, not LLM evaluation benchmarks. | |
| PDE-PFN: Prior-Data Fitted Neural PDE Solver Proposes a transformer solver that uses in-context learning trained on approximate solutions to predict partial differential equation fields. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant In-context PDE solver framework, not LLM evaluation or benchmark design. | |
| AgentTune: A Unified Training Lifecycle for Tool-Using LLM Agents Presents an open-source library that unifies training, evaluation, reinforcement learning, and distillation workflows for tool-using language model agents. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents a broad framework for training and running agents, not an LLM benchmark or evaluation study. | |
| Understanding Mamba-3 Through Oscillatory Dynamics Analyzes Mamba-3's input-dependent state rotations as oscillatory dynamics to explain their utility for tracking states and long-context language modeling. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Analyzes recurrent sequence model dynamics, not LLM evaluation benchmarks or methodologies. | |
| Hidden Data Challenges in Clinical Machine Learning Identifies and evaluates temporal, semantic, and population preprocessing misalignments that cause data leakage and bias in clinical machine learning pipelines. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Audits clinical tabular preprocessing pipelines, not LLM evaluation or benchmark methodology. | |
| EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning Proposes a reinforcement learning framework with verifiable rewards and error grounding to align multimodal emotion descriptions with human preferences. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Method for training emotion preference models, not an LLM evaluation framework or benchmark study. | |
| Opening the Black Box of Classifier-Free Guidance via Information Bottleneck Analyzes classifier-free guidance in diffusion models through an information bottleneck framework to characterize when conditioning information is most effective. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Analyzes classifier-free guidance in diffusion, not LLM evaluation or benchmark validity. | |
| BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning Introduces a conjugate gradient solver for large-scale kernel ridge regression using sketched block preconditioning to improve memory efficiency and convergence. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Scalable kernel solver algorithm, not LLM evaluation or benchmark reliability. | |
| PlacePulse: Learning Transferable Place Representations from Structural Geographic Data Presents a geospatial foundation model that creates structural place embeddings from sociodemographic and business data across hexagonal spatial units. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Introduces a geospatial foundation model and benchmark, not an evaluation method for language models. | |
| Model-free Bayesian Clustering and Multimodal Posterior Summarisation Develops a model-free Bayesian clustering method using martingale posteriors and Wasserstein summarization to bypass explicit likelihoods and MCMC sampling. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Bayesian clustering methodology, not LLM evaluation frameworks or benchmark metrics. | |
| Why Linear Models Can Still Work in a Complex and Changing World Analyzes theoretically and empirically why linear models often out-predict complex nonlinear models under finite samples and environment distribution shifts. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical paper explaining linear model transferability, not LLM benchmark design or evaluation protocols. | |
| Desertification Forecasting in Semi-Arid Regions: Using Deep Learning to Probe the Observability Limits of Land Degradation Dynamics Uses a convolutional LSTM on satellite data to evaluate the predictability and observational limits of year-to-year land degradation dynamics. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Satellite land degradation forecasting study, not general LLM evaluation or benchmark design. | |
| Accelerating Linear Bandits with Persistent Candidate Sets Introduces an efficient linear bandit algorithm that maintains a small candidate set of actions to reduce per-round evaluation costs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical bandit algorithm acceleration, not LLM evaluation or benchmarking frameworks. | |
| One Thing Leads to Another: The Essentials of Time Series Causal Discovery Provides a comprehensive tutorial on time series causal discovery methods, covering underlying principles, evaluation techniques, and practical applications. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Tutorial on time series causal discovery methods, not LLM evaluation benchmarks or testing protocols. | |
| Learning by Compression: Risk Estimates Attain the Law-of-Large-Numbers Rate Proves that risk estimates derived from preferent compression schemes achieve standard law-of-large-numbers rates without excess logarithmic factors. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Statistical learning theory on risk bounds, not empirical LLM evaluation or benchmark frameworks. | |
| Harmonic analysis and circuit approximation of Sobolev functions on quantum input spaces Derives theoretical approximation rates for Sobolev functions on quantum state and gate spaces using harmonic analysis and finite-depth quantum circuits. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on quantum Sobolev function approximation, not LLM benchmarks or evaluation trustworthiness. | |
| A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition Introduces a learned primal-dual solver for nonlinear model predictive control that uses temporal decomposition to scale independently of the prediction horizon. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Addresses learned optimization for nonlinear predictive control, not LLM benchmarks or evaluation methods. | |
| FedPCD: Priority-Constrained Federated Aggregation Proposes a federated optimization framework that preserves global aggregate objectives while applying minimal corrections to meet individual client performance constraints. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on federated optimization algorithms, not LLM evaluation methods or benchmark datasets. | |
| Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers Analyzes the discrete-time dynamical system of transformer self-attention, classifying its equilibria and showing consensus alignment with the value matrix's principal eigenvector. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical analysis of self-attention dynamical systems, not LLM evaluation benchmarks or methodologies. | |
| Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models Simulates transformer training loss spikes using quadratic models with heavy-tailed inputs and derives an adaptive optimizer hyperparameter schedule to prevent them. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies pre-training loss spike dynamics theoretically, not LLM benchmark design or evaluation trustworthiness. | |
| Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data Evaluates Transformer models trained with quantile loss on historical vessel position data to produce probabilistic ship trajectory forecasts. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Evaluates maritime vessel trajectory forecasting, not LLM evaluation or benchmarks. | |
| Rationally Linearized MLPs Linearizes multilayer perceptrons using low-degree rational approximations of activation functions to reduce inference costs across 3D models and language models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on MLP linearization techniques, not benchmark creation or LLM evaluation. | |
| Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment Presents an online randomized TCP acknowledgment algorithm that provides simultaneous competitive ratio bounds and sublinear regret against the best expert. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Online algorithms paper for networking TCP ACK, unrelated to LLM benchmarks. | |
| $L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression Applies Monte Carlo Tree Search with generalized rollout policy adaptation to optimize out-of-sample feature selection for high-dimensional financial regression. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Deals with financial feature selection via search, not LLM benchmarks or evaluation. | |
| Probabilistic Forecasting of Electric Vehicle Charging in a Time-varying Hierarchical Infrastructure Combines hierarchical forecasting with conformal prediction under missing data to forecast electric vehicle charging demand with valid prediction intervals across evolving networks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies conformal prediction for EV demand forecasting, not LLM evaluation or benchmarks. | |
| Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets Investigates theoretical lower bounds for randomized linear minimization oracle optimization algorithms over strongly convex sets. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical optimization lower bounds paper, unrelated to LLM evaluation. | |
| EchoTab: Learning Measurement-Grounded Representations for Echocardiographic Diagnosis through Tabular Reconstruction Proposes a measurement-grounded representation framework using tabular tokens to link multi-view echocardiograms to clinical diagnostic tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes medical imaging representation learning, not LLM benchmarks or evaluation. | |
| A small cognitive core explains human behavior at scale Presents a cognitive architecture based on episodic memory hierarchies and context-dependent error updates to predict human choice behavior. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Cognitive psychology computational model of human choices, not an LLM evaluation benchmark. | |
| CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope Proposes an unconstrained parameterization and equivariant flow matching model for generating valid correlation matrices. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Introduces a flow matching method for correlation matrices, not an LLM benchmark. | |
| Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training Presents a cycle-consistent adversarial model enabling continuous sound pressure level adjustments for speech vocal intensity conversion. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Covers speech synthesis and vocal intensity conversion, not LLM evaluation or benchmarks. | |
| Some remarks on the connection between generative diffusion and optimal transport Analyzes theoretical connections between generative diffusion models, flow matching, and entropic optimal transport formulations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical analysis of diffusion and optimal transport, not LLM evaluation or benchmarks. | |
| Kernel-based External Validity of Experimental Studies Develops a kernel-based maximum mean discrepancy framework to formalize and estimate the external validity and replicability of experimental studies. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Addresses theoretical statistical external validity using kernels, not LLM evaluation benchmarks. | |
| JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation Introduces a replay benchmark to evaluate robot motion smoothness and controller latency in vision-language-action manipulation pipelines. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Benchmark focuses on robotic motion quality in controllers, not LLM evaluation methods. | |
| Private and Distributionally Robust Federated Multiclass Classification Develops a differentially private and distributionally robust ADMM framework for multiclass classification across distributed client data. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on federated classification algorithms, not LLM evaluation or benchmarks. | |
| PANDA: Prior-guided Attentional Dual-path Architecture Presents a dual-path architecture combining normalized attention and incidence priors for hypergraph message-passing neural networks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents hypergraph neural network architecture, unrelated to LLM evaluation benchmarks. | |
| Electron-Density-Informed Molecular Property Prediction Using Surrogate Functionals Applies a surrogate functional framework incorporating ground-state electron density to improve molecular property prediction models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Addresses chemical molecular property prediction, not LLM evaluation or benchmarks. | |
| A Critical Look at Power Sampling when Test Time Sharpening LLMs Examines sampling methods for test-time sharpening in language models and shows simple best-of-N approaches yield comparable gains. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies test-time sampling distributions for reasoning rather than developing evaluation benchmarks. | |
| TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy Introduces a benchmark evaluating tabular foundation models across point prediction, distributional calibration, and prediction interval efficiency. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Benchmark is specifically for tabular foundation models, not LLM evaluation or language benchmarks. | |
| Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields Proposes a scalable variational inference method using sparse autoregressive structures and normalizing flows for non-Gaussian spatial field models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on variational inference for spatial statistics, not LLM benchmarks or evaluation. | |
| On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models Compares seven calendar feature encoding techniques across four time series foundation models to evaluate impact on forecast accuracy. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Evaluates calendar feature encodings in time series models, not language model evaluation benchmarks. | |
| VQIL: Visible Quantum Interference Learning for Perturbation Response Ranking on Graphs Introduces a parameterized quantum-walk model optimized via backpropagation to rank network node responses to seed perturbations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes a quantum walk method for graph ranking, not an LLM benchmark or evaluation. | |
| Transformer-based In-Context Score Operator Learning for Diffusion Models Proposes an in-context score operator framework allowing diffusion models to adapt to unseen target distributions without retraining. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents an in-context operator framework for diffusion models, not LLM benchmarking. | |
| Towards Understanding the Training of GFlowNets: A Theoretical Perspective Develops a theoretical framework linking training objective losses to sampling accuracy and finite-time convergence in Generative Flow Networks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical analysis of GFlowNets convergence, not language model evaluation. | |
| Machine Unlearning for Federated Socially Fair k-Means Clustering Presents an exact machine unlearning method for federated socially fair k-means clustering using separate group-level local summaries. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Addresses machine unlearning in federated clustering, not language model evaluation. | |
| SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark Introduces a multi-mode urban mobility benchmark across Seoul to evaluate origin-destination travel demand forecasting models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Benchmark is for urban origin-destination traffic flow forecasting, not language model evaluation. | |
| SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices Presents a compressed latent world-action model enabling faster robotic manipulation inference on resource-constrained edge hardware. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes a lightweight robotic policy model rather than an LLM evaluation benchmark. | |
| Studying the Effects of Task Diversity Using Small Mathematical Worlds Introduces two synthetic mathematical task datasets to study how task diversity affects model learning during pretraining. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Introduces synthetic math environments to analyze training dynamics, not LLM benchmark evaluation. | |
| How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference? Empirically evaluates the Bayesian posterior approximation quality and amortization errors of prior-data fitted networks across synthetic prior tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Analyzes Bayesian approximation error in Prior-Data Fitted Networks, not LLM benchmarks. | |
| From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds Introduces an information-theoretic framework using rate-distortion theory to establish computable lower bounds on feature reconstruction under DP-SGD. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on differential privacy reconstruction bounds rather than LLM evaluation or benchmarks. |
2,941–3,000 of 3,345← PreviousNext →