Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference
The authors present an autotuning framework for WebGPU kernels to improve cross-platform inference speeds for language models on edge devices.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents GPU kernel implementations rather than LLM benchmarks or evaluation methods.
Accounting for model error in ensemble variational data assimilation through learned generative dynamics
The authors present an ensemble variational data assimilation algorithm that incorporates learned generative forecasting models to account for complex model errors.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Covers geophysical data assimilation, not language model evaluation.
Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales
The authors introduce a parameter-free conformal martingale method modeled as a universal portfolio to quickly detect distribution shifts at unknown times.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Develops conformal martingales for distribution shift, not LLM benchmarks or evaluations.
HarnessTTT: Learn to Optimize Harness at Test-Time for Scientific Discovery
The authors propose a test-time learning method that trains a proposer to generate prompts, tools, and controls guiding scientific discovery agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on test-time harness optimization for scientific discovery, not benchmark evaluation design.
Robustly Reliable Learning for Regression
The authors analyze robustly reliable learning for regression under data corruptions and propose an algorithm to compute optimal prediction intervals for Lipschitz predictors.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical study of regression prediction bounds, not LLM evaluation benchmarks.
Variable Input Masked Autoencoders for Wrist-Worn Accelerometry
The authors introduce a masked autoencoder that pretrains wearable sensor representations across varied recording durations and sampling rates using cross-resolution views.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates wearable sensor encoders, not language model evaluation or benchmarks.
Measure Neural Mappings
The authors define measure neural mappings and establish quantitative error bounds for self-attention transformers acting on probability measures in unbounded spaces.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Mathematical analysis of attention on probability measures, not LLM benchmark evaluation.
A Method for Exact Enforcement of Boundary Conditions on General Curved Triangular Domains: Algorithm and Application to Scientific Machine Learning
The authors present a mathematical method to enforce Dirichlet, Neumann, and Robin boundary conditions exactly on curved triangular domains for scientific machine learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Addresses boundary value problems in numerical analysis, not LLM benchmarks.
JustOPD: On-Policy Distillation from Autoregressive to Diffusion Language Models
The authors introduce an on-policy distillation method to transfer knowledge from autoregressive language models into diffusion language models using autoregressive rollouts.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Introduces a knowledge distillation technique rather than a benchmark or evaluation method.
Position: Beyond Training Time, Test-Time Coordination is Essential for Cooperative MARL
The authors argue that cooperative multi-agent reinforcement learning systems require test-time coordination mechanisms rather than relying solely on training-time centralized information.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes a coordination paradigm in reinforcement learning, not LLM evaluation methodologies.
When Sparsity Breaks Connectivity: Functional Reachability and Guided Topology Dynamics in Extreme Sparse Training
The authors develop a reachability-guided dynamic sparse training method that preserves functional pathways during extreme network pruning and regrowth.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies sparse training dynamics rather than LLM evaluation or benchmark design.
Monarch-Muon: Structure-Aware Muon for Fast and Memory-Efficient Pretraining
The authors propose an optimizer for Monarch-factored weights that replaces dense matrix orthogonalization with smaller block updates to reduce memory and pretraining time.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents an optimization algorithm rather than an LLM evaluation framework or benchmark.
Formal-Verification-Guided Bayesian Optimization for Non-Intrusive Last-Mile Coverage Closure
The authors present a verification workflow combining reachability analysis with Bayesian optimization to close residual test bins in chip design verification.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on hardware verification coverage closure rather than language model evaluation.
On Sleep-Wake Disorder Identification from Polysomnographic Representations
The authors compare self-supervised and sleep-stage-supervised representations for identifying sleep-wake disorders across thousands of polysomnography recordings.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates sleep polysomnography models rather than LLM benchmarks or evaluation methods.
Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning
The authors analyze continual learning on a spherical parameter space to determine how many tasks a model can learn without catastrophic forgetting.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical analysis of continual learning parameter spaces, not LLM evaluation methods.
Selective Inference for Clustering Under Unknown Covariance
The authors introduce a selective hypothesis test for comparing cluster means under an unknown covariance matrix without inflating false-positive rates.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Covers post-clustering statistical inference, not language model evaluation or benchmarks.
From Orbit Matching to Docking: A Hierarchical Reinforcement-Learning Approach to Multiphase Rendezvous Trajectory Design
The paper proposes a hierarchical reinforcement learning framework to automate multi-phase spacecraft rendezvous and docking trajectories.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Does not benchmark or evaluate language models.
Structure-preserving fidelity diagnostics for partial differential equations
The paper introduces diagnostic scores to test whether neural network surrogates respect underlying physical conservation laws rather than numerical errors.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Develops physics diagnostic metrics for differential equations rather than LLM benchmarks.
A Time-Synchronous Prequential Evaluation Framework for Next-Week Student Disengagement Prediction from Moodle LMS Logs
The paper evaluates online machine learning models within a time-synchronous framework to predict weekly student disengagement from activity logs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies student disengagement prediction rather than language model evaluation or benchmarks.
Longitudinal Learner Participation Profiling in Online Learning: Heterogeneous Consensus Clustering under Unequal Observation Windows
The paper evaluates clustering methods on learning management system logs to identify learner participation profiles across unequal observation windows.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes student participation clustering rather than language model evaluation or benchmarking.
Merit: Making every modality earn its contribution in multimodal attention decoding
The paper introduces a multimodal auditory attention decoding framework designed to maintain reliance on neural signals alongside behavioural tracking.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates auditory attention decoding inputs rather than language model benchmarking methods.
ATTUNE: Agentic Throughput Tuning for LLM Training
The paper presents an automated coding agent that tunes large model training configurations for throughput under user-defined compute budgets.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on tuning distributed training throughput rather than LLM evaluation benchmarks.
Risk-Averse Inference-Time Diffusion Model Alignment with Finite-Sample Guarantees
The paper proposes an inference-time alignment method that optimizes expected costs while controlling tail risk in diffusion models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes diffusion alignment algorithms rather than language model evaluation benchmarks.
Training Generalist Navigation Policies via Action Self-Distillation
The paper introduces a self-distillation framework where a vision-language model teaches itself language-conditioned robotic navigation policies without human annotations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents a robot navigation policy rather than an LLM evaluation benchmark.
FedLoRD: Personalized Federated Learning based on Low-Rank Structures of Model Parameter Differences
The paper introduces a personalized federated learning method that regularizes local model updates using low-rank difference structures.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on personalized federated learning rather than language model evaluation frameworks.
Mixed Precision Scaling Laws for Quantized Pretraining
The paper proposes mixed precision scaling laws to model the trade-offs of low-precision quantization during model pretraining.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies scaling behavior under quantization rather than general LLM evaluation benchmarks.
textGrain watermarking is harder to detect: can sum-tests still do it optimally?
The paper analyzes the theoretical detection limits and sum-test efficiency of textGrain watermarking under human text edits.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes statistical watermark detection boundaries rather than general LLM evaluation benchmarks.
Focus on What You Need: Global-to-Local Dynamic Attention for Multimodal Sarcasm Detection
The paper introduces a global-to-local dynamic attention model to filter visual noise and improve multimodal sarcasm detection.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents a multimodal sarcasm classifier rather than an LLM evaluation benchmark.
Confine to the Task, Anchor the Rest: Concept-Guided Retention Regularizer for Parameter-Efficient Fine-Tuning
The paper proposes a concept-guided regularizer using sparse autoencoders to reduce catastrophic forgetting during parameter-efficient fine-tuning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes a regularizer for parameter-efficient tuning rather than an LLM evaluation benchmark.
MissPath-FM: Flow Matching with Structured Priors for Partially Observed Time Series
The paper develops a flow matching framework with structured priors to model partially observed time series without wasting capacity on observed entries.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates time series imputation rather than language model evaluation or benchmarking.
Representation Geometry and Inductive Biases in Quantum Classifiers across Classical Visual Benchmarks
The paper investigates the representation geometry and inductive biases of quantum classifiers when applied to classical visual benchmark datasets.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Compares quantum classifier inductive biases rather than language model evaluation benchmarks.
Hybrid Parallel Bessel KAN Model: a Kolmogorov Arnold Network: integrated framework for developing a novel architecture to reconstruct the fused-basis approach via a parameter free quadratic interaction
The paper proposes a Kolmogorov-Arnold Network architecture using parallel Bessel branches and quadratic interactions to reduce parameters and conditioning problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates Kolmogorov-Arnold Network variants rather than language model benchmarking methods.
Follow the Perturbed Leader for Linear Bandits: $\sqrt{T}$ Regret over General Convex Sets
The paper provides an adversarial linear bandit algorithm achieving sublinear regret over general convex action sets using follow-the-perturbed-leader.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes theoretical bandit regret bounds rather than language model evaluation frameworks.
GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning
The paper presents a geometry-aware pretraining framework that aligns heterogeneous probe layouts for functional near-infrared spectroscopy representation learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies fNIRS neuroimaging representations rather than language model benchmark design.
Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence Diagrams
The paper proposes a minimal positional encoding method using random Fourier features to feed persistence diagrams directly into standard Transformers.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates topological representation methods on graph tasks rather than LLM benchmarking.
Deep Mesoscopic Dynamics
The paper develops a neural network approach to learn effective mesoscopic field equations directly from microscopic trajectory data.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on physics PDE surrogate modeling rather than language model evaluation.
FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention
The paper presents an expressive and distributed attention kernel that compresses structured attention masks to enable efficient context parallelism on Hopper GPUs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Introduces an attention kernel optimization, not an evaluation benchmark.
Stable-Plastic Subspace Construction for Differentially Private Continual LoRA
The paper presents a subspace construction method for continual low-rank adaptation to mitigate forgetting under differential privacy constraints.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Addresses private continual fine-tuning methods, not evaluation benchmarks.
NBCLT: Parameter-Agnostic Norm-Ball Clipped Local Training
The paper introduces a unified local training framework using norm-ball clipping to improve communication efficiency in distributed and federated learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies federated learning optimization algorithms, not LLM evaluation.
Stein Variational Distributional Reinforcement Learning: Score-Guided Particles for Multivariate Return Distributions
The paper introduces a score-guided particle framework using Stein variational gradient descent to model multivariate return distributions in reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on reinforcement learning algorithms, not LLM evaluation benchmarks.
Learning Distributions from Samples and Qualities
This paper establishes accelerated parameter estimation rates when continuous data samples are accompanied by binary quality labels or pairwise preferences.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical statistical estimation paper, not LLM evaluation.
CALM-5G: Event-Level Conformal Risk Control for Predictive Service-Assurance Alarms
This paper proposes a conformal risk control layer that certifies miss rates and reduces alarm duty cycles in predictive cellular network operations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on 5G network telemetry forecasting, not language model evaluation.
Neural Dimensional Analysis: Foundations of Dimensionless and Scale-Consistent Computation
This paper introduces a dimensional analysis framework and diagnostic metrics to maintain scale consistency across Transformer components.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Addresses model architectural scaling principles rather than evaluation benchmarks.
AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding
This paper presents an error-controlled compression codec for key-value caches using coordinate alignment and predictive coding.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on KV cache compression techniques rather than general LLM evaluation.
All-electron machine-learned orbital-free density functional for periodic CHNO systems
This paper presents an equivariant neural network functional to perform orbital-free density functional theory for periodic CHNO systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Concerns computational chemistry and density functional theory, not LLMs.
Exact power indices for plurality-voting ensembles
This paper introduces an exact method to compute Banzhaf and Shapley power indices for base classifiers in plurality-voting ensembles.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical attribution work on ensemble voting, not LLM evaluation.
Counterfactual Certification for Sequential Unlearning with Long-Run Performance Guarantees
This paper proposes a counterfactual certification framework to bound performance loss during sequential machine unlearning requests.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Deals with certified machine unlearning, not LLM evaluation.
Improving Neural Symbolic Regression with a Diverse Prior and Post-training Alignment
This paper improves neural symbolic regression by using a tabular prior and reinforcement learning alignment to fit noisy data.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on symbolic regression algorithms rather than LLM evaluation or benchmarks.
Weighting-Based Strategies for Classification: Analysis and Local Peak Dynamics with CART Trees
This paper theoretically and empirically compares weighting-based rebalancing strategies to unweighted methods in imbalanced tabular classification tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical tabular classification analysis, not language model evaluation.
LADDER: A Long-Horizon Robot Manipulation Benchmark
This paper introduces a robot manipulation benchmark to isolate failures across scaling subgoal horizons and orchestration methods.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Introduces a robotic manipulation benchmark rather than an LLM evaluation benchmark.
Reliable Scale-Free Bandits via Empirical Likelihood
This paper develops an empirical-likelihood bandit policy that provides asymptotic regret guarantees without knowledge of reward scales.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical study of multi-armed bandits, not LLM benchmarking.
Causal Discovery Under Hard Selection Bias: A New Robust Score-Matching Approach
This paper proposes a score-matching approach for causal discovery in additive noise models under hard selection bias and truncation.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical causal discovery work, not language model evaluation.
Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agents
This paper introduces a framework combining persistent belief states with implicit world modeling to help long-horizon language agents recover from failures.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents an agent framework and distillation method rather than a general evaluation benchmark.
Same Function, Different Trajectory: No Standard Optimizer Is Equivariant to Transformer Reparameterization
This paper demonstrates that standard optimizers are sensitive to parameter scaling in Transformers and proposes a symmetry-aware gradient adjustment.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on optimizer reparameterization dynamics rather than LLM evaluation or benchmarks.
From Spectral Saliency to Finite Deletion: Evaluating Selective Language Model Edits
This paper analyzes prediction errors in spectral saliency when deleting singular components to selectively edit language model capabilities.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates selective weight editing methods rather than assessing general LLM capabilities.
The Effect of Layer Ordering in Hybrid Architectures
This paper analyzes how layer ordering and selection affect performance across tasks in hybrid attention model architectures.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes architecture design theory, not benchmark creation or evaluation.
Distance Prediction for Quantum Codes
This paper introduces an attention-based neural network to predict code distances for bivariate bicycle quantum low-density parity-check codes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Predicts quantum code distances, not language model evaluation.
Revisiting Error Feedback for Model Quantization
This paper formulates a trace-minimization framework to design causal error-feedback coefficients for neural network weight quantization.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on model quantization techniques, not LLM evaluation benchmarks.
Learning a Group Element from Its Action: Galois Correspondences, Optimal ERM, and an Abel-Ruffini Threshold for the Natarajan Dimension
This paper analyzes the sample and mistake complexity of learning group elements from actions using Galois correspondences and multiclass dimensions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Abstract learning theory and group theory, not LLM evaluation.
Random Probing for Structural Self-Interactions in Graph Neural Networks
This paper proposes a message-passing layer using randomized probing of operator diagonals to capture node self-interactions in graph neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Deals with graph neural network expressivity, not LLM evaluation.
1,801–1,860 of 3,345← PreviousNext →