Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference The authors present an autotuning framework for WebGPU kernels to improve cross-platform inference speeds for language models on edge devices. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents GPU kernel implementations rather than LLM benchmarks or evaluation methods. | |
| Accounting for model error in ensemble variational data assimilation through learned generative dynamics The authors present an ensemble variational data assimilation algorithm that incorporates learned generative forecasting models to account for complex model errors. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Covers geophysical data assimilation, not language model evaluation. | |
| Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales The authors introduce a parameter-free conformal martingale method modeled as a universal portfolio to quickly detect distribution shifts at unknown times. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Develops conformal martingales for distribution shift, not LLM benchmarks or evaluations. | |
| HarnessTTT: Learn to Optimize Harness at Test-Time for Scientific Discovery The authors propose a test-time learning method that trains a proposer to generate prompts, tools, and controls guiding scientific discovery agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on test-time harness optimization for scientific discovery, not benchmark evaluation design. | |
| Robustly Reliable Learning for Regression The authors analyze robustly reliable learning for regression under data corruptions and propose an algorithm to compute optimal prediction intervals for Lipschitz predictors. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical study of regression prediction bounds, not LLM evaluation benchmarks. | |
| Variable Input Masked Autoencoders for Wrist-Worn Accelerometry The authors introduce a masked autoencoder that pretrains wearable sensor representations across varied recording durations and sampling rates using cross-resolution views. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates wearable sensor encoders, not language model evaluation or benchmarks. | |
| Measure Neural Mappings The authors define measure neural mappings and establish quantitative error bounds for self-attention transformers acting on probability measures in unbounded spaces. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Mathematical analysis of attention on probability measures, not LLM benchmark evaluation. | |
| A Method for Exact Enforcement of Boundary Conditions on General Curved Triangular Domains: Algorithm and Application to Scientific Machine Learning The authors present a mathematical method to enforce Dirichlet, Neumann, and Robin boundary conditions exactly on curved triangular domains for scientific machine learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Addresses boundary value problems in numerical analysis, not LLM benchmarks. | |
| JustOPD: On-Policy Distillation from Autoregressive to Diffusion Language Models The authors introduce an on-policy distillation method to transfer knowledge from autoregressive language models into diffusion language models using autoregressive rollouts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Introduces a knowledge distillation technique rather than a benchmark or evaluation method. | |
| Position: Beyond Training Time, Test-Time Coordination is Essential for Cooperative MARL The authors argue that cooperative multi-agent reinforcement learning systems require test-time coordination mechanisms rather than relying solely on training-time centralized information. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes a coordination paradigm in reinforcement learning, not LLM evaluation methodologies. | |
| When Sparsity Breaks Connectivity: Functional Reachability and Guided Topology Dynamics in Extreme Sparse Training The authors develop a reachability-guided dynamic sparse training method that preserves functional pathways during extreme network pruning and regrowth. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies sparse training dynamics rather than LLM evaluation or benchmark design. | |
| Monarch-Muon: Structure-Aware Muon for Fast and Memory-Efficient Pretraining The authors propose an optimizer for Monarch-factored weights that replaces dense matrix orthogonalization with smaller block updates to reduce memory and pretraining time. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents an optimization algorithm rather than an LLM evaluation framework or benchmark. | |
| Formal-Verification-Guided Bayesian Optimization for Non-Intrusive Last-Mile Coverage Closure The authors present a verification workflow combining reachability analysis with Bayesian optimization to close residual test bins in chip design verification. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on hardware verification coverage closure rather than language model evaluation. | |
| On Sleep-Wake Disorder Identification from Polysomnographic Representations The authors compare self-supervised and sleep-stage-supervised representations for identifying sleep-wake disorders across thousands of polysomnography recordings. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates sleep polysomnography models rather than LLM benchmarks or evaluation methods. | |
| Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning The authors analyze continual learning on a spherical parameter space to determine how many tasks a model can learn without catastrophic forgetting. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical analysis of continual learning parameter spaces, not LLM evaluation methods. | |
| Selective Inference for Clustering Under Unknown Covariance The authors introduce a selective hypothesis test for comparing cluster means under an unknown covariance matrix without inflating false-positive rates. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Covers post-clustering statistical inference, not language model evaluation or benchmarks. | |
| From Orbit Matching to Docking: A Hierarchical Reinforcement-Learning Approach to Multiphase Rendezvous Trajectory Design The paper proposes a hierarchical reinforcement learning framework to automate multi-phase spacecraft rendezvous and docking trajectories. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Does not benchmark or evaluate language models. | |
| Structure-preserving fidelity diagnostics for partial differential equations The paper introduces diagnostic scores to test whether neural network surrogates respect underlying physical conservation laws rather than numerical errors. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Develops physics diagnostic metrics for differential equations rather than LLM benchmarks. | |
| A Time-Synchronous Prequential Evaluation Framework for Next-Week Student Disengagement Prediction from Moodle LMS Logs The paper evaluates online machine learning models within a time-synchronous framework to predict weekly student disengagement from activity logs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies student disengagement prediction rather than language model evaluation or benchmarks. | |
| Longitudinal Learner Participation Profiling in Online Learning: Heterogeneous Consensus Clustering under Unequal Observation Windows The paper evaluates clustering methods on learning management system logs to identify learner participation profiles across unequal observation windows. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes student participation clustering rather than language model evaluation or benchmarking. | |
| Merit: Making every modality earn its contribution in multimodal attention decoding The paper introduces a multimodal auditory attention decoding framework designed to maintain reliance on neural signals alongside behavioural tracking. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates auditory attention decoding inputs rather than language model benchmarking methods. | |
| ATTUNE: Agentic Throughput Tuning for LLM Training The paper presents an automated coding agent that tunes large model training configurations for throughput under user-defined compute budgets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on tuning distributed training throughput rather than LLM evaluation benchmarks. | |
| Risk-Averse Inference-Time Diffusion Model Alignment with Finite-Sample Guarantees The paper proposes an inference-time alignment method that optimizes expected costs while controlling tail risk in diffusion models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes diffusion alignment algorithms rather than language model evaluation benchmarks. | |
| Training Generalist Navigation Policies via Action Self-Distillation The paper introduces a self-distillation framework where a vision-language model teaches itself language-conditioned robotic navigation policies without human annotations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents a robot navigation policy rather than an LLM evaluation benchmark. | |
| FedLoRD: Personalized Federated Learning based on Low-Rank Structures of Model Parameter Differences The paper introduces a personalized federated learning method that regularizes local model updates using low-rank difference structures. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on personalized federated learning rather than language model evaluation frameworks. | |
| Mixed Precision Scaling Laws for Quantized Pretraining The paper proposes mixed precision scaling laws to model the trade-offs of low-precision quantization during model pretraining. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies scaling behavior under quantization rather than general LLM evaluation benchmarks. | |
| textGrain watermarking is harder to detect: can sum-tests still do it optimally? The paper analyzes the theoretical detection limits and sum-test efficiency of textGrain watermarking under human text edits. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes statistical watermark detection boundaries rather than general LLM evaluation benchmarks. | |
| Focus on What You Need: Global-to-Local Dynamic Attention for Multimodal Sarcasm Detection The paper introduces a global-to-local dynamic attention model to filter visual noise and improve multimodal sarcasm detection. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents a multimodal sarcasm classifier rather than an LLM evaluation benchmark. | |
| Confine to the Task, Anchor the Rest: Concept-Guided Retention Regularizer for Parameter-Efficient Fine-Tuning The paper proposes a concept-guided regularizer using sparse autoencoders to reduce catastrophic forgetting during parameter-efficient fine-tuning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes a regularizer for parameter-efficient tuning rather than an LLM evaluation benchmark. | |
| MissPath-FM: Flow Matching with Structured Priors for Partially Observed Time Series The paper develops a flow matching framework with structured priors to model partially observed time series without wasting capacity on observed entries. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates time series imputation rather than language model evaluation or benchmarking. | |
| Representation Geometry and Inductive Biases in Quantum Classifiers across Classical Visual Benchmarks The paper investigates the representation geometry and inductive biases of quantum classifiers when applied to classical visual benchmark datasets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Compares quantum classifier inductive biases rather than language model evaluation benchmarks. | |
| Hybrid Parallel Bessel KAN Model: a Kolmogorov Arnold Network: integrated framework for developing a novel architecture to reconstruct the fused-basis approach via a parameter free quadratic interaction The paper proposes a Kolmogorov-Arnold Network architecture using parallel Bessel branches and quadratic interactions to reduce parameters and conditioning problems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates Kolmogorov-Arnold Network variants rather than language model benchmarking methods. | |
| Follow the Perturbed Leader for Linear Bandits: $\sqrt{T}$ Regret over General Convex Sets The paper provides an adversarial linear bandit algorithm achieving sublinear regret over general convex action sets using follow-the-perturbed-leader. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes theoretical bandit regret bounds rather than language model evaluation frameworks. | |
| GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning The paper presents a geometry-aware pretraining framework that aligns heterogeneous probe layouts for functional near-infrared spectroscopy representation learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies fNIRS neuroimaging representations rather than language model benchmark design. | |
| Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence Diagrams The paper proposes a minimal positional encoding method using random Fourier features to feed persistence diagrams directly into standard Transformers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates topological representation methods on graph tasks rather than LLM benchmarking. | |
| Deep Mesoscopic Dynamics The paper develops a neural network approach to learn effective mesoscopic field equations directly from microscopic trajectory data. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on physics PDE surrogate modeling rather than language model evaluation. | |
| FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention The paper presents an expressive and distributed attention kernel that compresses structured attention masks to enable efficient context parallelism on Hopper GPUs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Introduces an attention kernel optimization, not an evaluation benchmark. | |
| Stable-Plastic Subspace Construction for Differentially Private Continual LoRA The paper presents a subspace construction method for continual low-rank adaptation to mitigate forgetting under differential privacy constraints. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Addresses private continual fine-tuning methods, not evaluation benchmarks. | |
| NBCLT: Parameter-Agnostic Norm-Ball Clipped Local Training The paper introduces a unified local training framework using norm-ball clipping to improve communication efficiency in distributed and federated learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies federated learning optimization algorithms, not LLM evaluation. | |
| Stein Variational Distributional Reinforcement Learning: Score-Guided Particles for Multivariate Return Distributions The paper introduces a score-guided particle framework using Stein variational gradient descent to model multivariate return distributions in reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on reinforcement learning algorithms, not LLM evaluation benchmarks. | |
| Learning Distributions from Samples and Qualities This paper establishes accelerated parameter estimation rates when continuous data samples are accompanied by binary quality labels or pairwise preferences. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical statistical estimation paper, not LLM evaluation. | |
| CALM-5G: Event-Level Conformal Risk Control for Predictive Service-Assurance Alarms This paper proposes a conformal risk control layer that certifies miss rates and reduces alarm duty cycles in predictive cellular network operations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on 5G network telemetry forecasting, not language model evaluation. | |
| Neural Dimensional Analysis: Foundations of Dimensionless and Scale-Consistent Computation This paper introduces a dimensional analysis framework and diagnostic metrics to maintain scale consistency across Transformer components. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Addresses model architectural scaling principles rather than evaluation benchmarks. | |
| AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding This paper presents an error-controlled compression codec for key-value caches using coordinate alignment and predictive coding. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on KV cache compression techniques rather than general LLM evaluation. | |
| All-electron machine-learned orbital-free density functional for periodic CHNO systems This paper presents an equivariant neural network functional to perform orbital-free density functional theory for periodic CHNO systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Concerns computational chemistry and density functional theory, not LLMs. | |
| Exact power indices for plurality-voting ensembles This paper introduces an exact method to compute Banzhaf and Shapley power indices for base classifiers in plurality-voting ensembles. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical attribution work on ensemble voting, not LLM evaluation. | |
| Counterfactual Certification for Sequential Unlearning with Long-Run Performance Guarantees This paper proposes a counterfactual certification framework to bound performance loss during sequential machine unlearning requests. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Deals with certified machine unlearning, not LLM evaluation. | |
| Improving Neural Symbolic Regression with a Diverse Prior and Post-training Alignment This paper improves neural symbolic regression by using a tabular prior and reinforcement learning alignment to fit noisy data. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on symbolic regression algorithms rather than LLM evaluation or benchmarks. | |
| Weighting-Based Strategies for Classification: Analysis and Local Peak Dynamics with CART Trees This paper theoretically and empirically compares weighting-based rebalancing strategies to unweighted methods in imbalanced tabular classification tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical tabular classification analysis, not language model evaluation. | |
| LADDER: A Long-Horizon Robot Manipulation Benchmark This paper introduces a robot manipulation benchmark to isolate failures across scaling subgoal horizons and orchestration methods. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Introduces a robotic manipulation benchmark rather than an LLM evaluation benchmark. | |
| Reliable Scale-Free Bandits via Empirical Likelihood This paper develops an empirical-likelihood bandit policy that provides asymptotic regret guarantees without knowledge of reward scales. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical study of multi-armed bandits, not LLM benchmarking. | |
| Causal Discovery Under Hard Selection Bias: A New Robust Score-Matching Approach This paper proposes a score-matching approach for causal discovery in additive noise models under hard selection bias and truncation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical causal discovery work, not language model evaluation. | |
| Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agents This paper introduces a framework combining persistent belief states with implicit world modeling to help long-horizon language agents recover from failures. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents an agent framework and distillation method rather than a general evaluation benchmark. | |
| Same Function, Different Trajectory: No Standard Optimizer Is Equivariant to Transformer Reparameterization This paper demonstrates that standard optimizers are sensitive to parameter scaling in Transformers and proposes a symmetry-aware gradient adjustment. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on optimizer reparameterization dynamics rather than LLM evaluation or benchmarks. | |
| From Spectral Saliency to Finite Deletion: Evaluating Selective Language Model Edits This paper analyzes prediction errors in spectral saliency when deleting singular components to selectively edit language model capabilities. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates selective weight editing methods rather than assessing general LLM capabilities. | |
| The Effect of Layer Ordering in Hybrid Architectures This paper analyzes how layer ordering and selection affect performance across tasks in hybrid attention model architectures. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes architecture design theory, not benchmark creation or evaluation. | |
| Distance Prediction for Quantum Codes This paper introduces an attention-based neural network to predict code distances for bivariate bicycle quantum low-density parity-check codes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Predicts quantum code distances, not language model evaluation. | |
| Revisiting Error Feedback for Model Quantization This paper formulates a trace-minimization framework to design causal error-feedback coefficients for neural network weight quantization. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on model quantization techniques, not LLM evaluation benchmarks. | |
| Learning a Group Element from Its Action: Galois Correspondences, Optimal ERM, and an Abel-Ruffini Threshold for the Natarajan Dimension This paper analyzes the sample and mistake complexity of learning group elements from actions using Galois correspondences and multiclass dimensions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Abstract learning theory and group theory, not LLM evaluation. | |
| Random Probing for Structural Self-Interactions in Graph Neural Networks This paper proposes a message-passing layer using randomized probing of operator diagonals to capture node self-interactions in graph neural networks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Deals with graph neural network expressivity, not LLM evaluation. |
1,801–1,860 of 3,345← PreviousNext →