Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| TRACER: Trace-Regularized Training Against Indirect Prompt Injection The paper introduces an adversarial training framework that hardens models against indirect prompt injection across retrieval and tool interaction channels. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on prompt injection defense training, not general benchmarking. | |
| Student Copula Markov Networks The paper extends undirected graphical models to non-Gaussian data using copula densities and provides an estimation algorithm. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical copula graphical model paper, not an LLM benchmark. | |
| Online Tokenization with Optimal Delay in Linear Time The paper introduces an online tokenization algorithm that processes text streams in linear time with minimal algorithmic delay. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents a tokenization algorithm, not an LLM benchmark. | |
| Towards Training and Inference of Graph Neural Networks in Graph Databases The paper shows how graph databases can execute graph neural network sampling, retrieval, and inference directly without separate in-memory pipelines. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on GNN database systems, not LLM evaluation benchmarks. | |
| Demystifying On-Policy Distillation: Where Does the Teacher's Advantage Live? The paper examines teacher interventions along student generation paths to identify how teacher guidance drives performance gains in on-policy distillation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Investigates distillation mechanics rather than LLM benchmarking suites. | |
| Learning in Strategic Queuing with Geometric Recharge: From Bandits to Systems The paper analyzes packet routing throughput when selfish queue agents use no-regret learning algorithms to select buffered servers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Analyzes multi-agent queuing theory, not LLM benchmarking. | |
| Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent The paper proposes a Bayesian full waveform inversion framework that uses learned diffusion models as regularizers for geological reconstruction. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Pertains to geophysics waveform inversion, not LLM evaluation. | |
| Adaptive Computation with Conformal Certification The paper develops an adaptive computation framework offering conformal uncertainty guarantees for processing large scientific and medical imagery efficiently. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Deals with conformal risk certification for imaging, not LLM benchmarks. | |
| FireGraphNet: Sub-daily wildfire spread prediction with directed graph neural networks The paper proposes a directed graph neural network approach to forecast twelve-hour wildfire spread using spatial and environmental attributes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Wildfire spread prediction with GNNs, not LLM evaluation. | |
| Spectral-MoE: Heterogeneous Per-Layer Expert Utilization in Dense-to-MoE Conversion The paper introduces a method to convert dense models into mixture-of-experts by dynamically allocating different numbers of active experts across layers. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on MoE model architecture optimization, not LLM benchmarking. | |
| From Detection To Anticipation: Continuous Onset Forecasting For Stuttered Speech The paper develops a continuous forecasting method using speech representations to anticipate stuttering events shortly before they occur. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Studies speech dysfluency forecasting, not LLM benchmark evaluation. | |
| LLMs program using Reusable and Composable Abstract Representations The paper demonstrates that language models use modular abstract representations to generalize code generation across different programming languages and strategies. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on mechanistic representation analysis rather than LLM benchmarking methods. | |
| Multi-Sensitive Distributional Fairness: Joint Wasserstein Audits and Shapley Allocation The paper presents a framework using Wasserstein geometry and Shapley values to audit and decompose intersectional fairness disparities across multiple attributes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on statistical fairness metrics rather than LLM evaluation benchmarks. | |
| Beyond Time Induction: Structured Conditional Neural Solvers for Parametric Stochastic-Volatility Pricing The paper introduces a neural solver architecture to accurately compute solutions and sensitivities for parametric stochastic volatility partial differential equations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Applies neural solvers to stochastic PDEs, not LLM evaluation. | |
| Outcome-Routed Distillation and Reinforcement Learning for Diffusion Language Models The paper presents an outcome-routed distillation and reinforcement learning method tailored for training mixture-of-experts diffusion language models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Develops a distillation training pipeline, not an evaluation framework. | |
| Exact Scaling Laws for a Random-Features Bigram Model The paper derives theoretical scaling laws for prediction regret in a capacity-constrained bigram model with power-law token frequencies. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical derivation of scaling laws, not empirical benchmark evaluation. | |
| Verifier-Grounded Agentic RL for Provably Correct Code The paper introduces an agentic reinforcement learning approach that uses formal program verifier diagnostics as intermediate rewards to produce verified code. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an RL training environment rather than LLM benchmarking methods. | |
| Historical-Feature Residual Adaptation for Sequential Screening The paper proposes an acquisition-time residual adaptation method that uses historical features to improve hit rates in sequential screening. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Deals with sequential screening policies, not LLM benchmark evaluation. | |
| Why don't Graph Transformers attend to the same token? The paper examines why molecular graph transformers avoid attention sink patterns seen in language models and highlights attention design impacts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Analyzes internal attention mechanisms in graph transformers, not benchmark evaluation. | |
| BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments The paper introduces a framework to translate and decompose clinical measurement records across heterogeneous assessment systems within predefined error tolerances. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on clinical measurement harmonization, not LLM evaluation. | |
| Dynamic Graph World Modelling: Learning Future Dynamics from Temporal Context The paper presents a dynamic graph framework to jointly forecast evolving node and relation representations from historical graph contexts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a dynamic graph architecture, not LLM evaluation benchmarks. | |
| RA$^2$: Retain-Anchored Attraction Preserves Forget-Adjacent Utility in LLM Unlearning The paper proposes a latent-space unlearning method that preserves model performance on benign tasks conceptually adjacent to forgotten domains. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on machine unlearning methodology, not LLM evaluation frameworks or benchmarks. | |
| Fully sequential Gaussian process regression for preference learning The paper presents a sequential Gaussian process method and sampling policy for continuous optimization based on pairwise preference comparisons. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Sequential Gaussian process regression theory, not LLM evaluation. | |
| Selective Next-Location Prediction with MetaModelSelect: A Lightweight Post-Hoc Confidence Metamodel The paper applies a lightweight post-hoc classifier to evaluate confidence and filter out incorrect next-location predictions from recurrent models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Post-hoc confidence metamodel for cellular next-location prediction, not LLM evaluation. | |
| ActMOF: Mapping Reticular Synthesis through Active Learning The paper introduces an experimental benchmark to evaluate active learning and Bayesian optimization strategies for synthesizing metal-organic frameworks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Benchmark for chemical reticular synthesis active learning, not LLM evaluation. | |
| W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition The paper introduces a self-supervised wavelet predictive architecture to extract multiscale motion features from wearable activity sensors. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Wearable sensor activity recognition, not language model evaluation. | |
| Comprehensive Comparisons of Reinforcement Learning Algorithms in Autonomous Driving The paper benchmarks four reinforcement learning algorithms on safety, data efficiency, and stability for autonomous vehicle intersection navigation. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Benchmarking autonomous vehicle RL algorithms, not language model evaluation. | |
| Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents The paper introduces a progress-aware distillation method to prevent small language model agents from stalling in repetitive loops during long tasks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on distillation training methods rather than new LLM evaluation benchmarks. | |
| Large-Step Last-Iterate Convergence of Random-Reshuffling Stochastic Gradient Descent The paper establishes theoretical last-iterate convergence rates for random-reshuffling stochastic gradient descent using larger stepsizes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical optimization theory for SGD, not LLM evaluation. | |
| State-Matched Sequence Conformal Prediction The paper proposes a sequential conformal prediction algorithm that groups calibration scores by state similarity rather than pure temporal recency. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on conformal prediction theory, not LLM benchmarking. | |
| Digital Self-Interference Cancellation for In-Band Full-Duplex Systems Based on Transformer Neural Operators The paper applies transformer neural operators to model interference channels and cancel digital self-interference in full-duplex radio systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Radio frequency signal cancellation, not language model evaluation. | |
| SKG: A Law-Induced Engine from Inference to Induction The paper presents a mathematical framework unifying symplectic geometry, kernel methods, and physical conservation laws for physics-constrained learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical physics-informed gradient reasoning engine, not LLM benchmarks. | |
| CktHGVAE: A Symmetric Design/State Heterogeneous Graph Variational Autoencoder for Transistor-level Analog/Mixed-signal Circuit Design and Analysis The paper introduces a heterogeneous graph variational autoencoder to model design and state variables jointly for analog circuit analysis. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Heterogeneous graph VAEs for analog circuits, not LLM evaluation. | |
| High-Probability Regret Bounds for Feel-Good Thompson Sampling The paper establishes theoretical high-probability regret bounds for feel-good Thompson sampling algorithms in contextual bandit problems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Contextual bandit regret theory, not language model evaluation or benchmarks. | |
| HankelKANet: Lightweight Path Loss Estimation via Physics-Inspired Hankel Convolution The paper proposes a neural network using physics-inspired Hankel convolution kernels for lightweight path loss estimation in wireless networks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on wireless path loss estimation, not LLM evaluation. | |
| Two-stage Residual Learning for Modelling Strength-Informed Optimisation of Thermal Systems The paper introduces a two-stage residual learning framework to detect local inaccuracies and guide the optimization of thermal systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Surrogate modeling for thermal systems, not LLM evaluation or benchmarks. | |
| Noisy-Label Calibration with Multiple Unreliable Labels The paper develops methods to evaluate and recalibrate binary predictors using noisy, multi-annotator labels without requiring clean ground truth. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Addresses general binary classification calibration under noisy labels, not LLM benchmarking. | |
| Test-Time Forecasting: Recurrent Depth Enables In-Context Dynamics Prediction The paper uses recurrent gradient descent iterations during test time to enable foundation models to forecast unseen dynamical systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on dynamical systems forecasting architectures, not LLM evaluation. | |
| Geometric Kernel Diversity: An Axiomatic Diversity Measure in Euclidean Space The paper introduces a continuous, monotonic geometric kernel measure and algorithms to efficiently compute diversity over Euclidean points. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Computational geometry for axiomatic diversity measures, not language model evaluation. | |
| On Inherent Privacy of Posterior Sampling: A Unified Rényi-Divergence Framework The paper develops a theoretical Rényi-divergence framework to measure inherent differential privacy guarantees obtained directly from Bayesian posterior sampling. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Addresses theoretical differential privacy bounds, not LLM evaluation frameworks. | |
| Projected Wasserstein-Fisher-Rao Flows for Hawkes Background-Intensity Estimation The paper proposes a variational method using Wasserstein-Fisher-Rao geometry to estimate the background intensity of Hawkes processes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical statistics for Hawkes processes, not LLM benchmarking or evaluation. | |
| InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design The paper introduces a model for de novo protein sequence generation guided by natural language instructions and biological context encoders. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on computational biology and protein sequence design, not LLM evaluation benchmarks. | |
| Risk-Controlled DFT Selection for Machine-Learned Interatomic Potentials The paper applies conformal risk control to decide when to trust machine-learned interatomic potentials versus running expensive physics calculations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Covers conformal risk control for interatomic potentials, not LLMs. | |
| Synthetic reaction data from transformation rules for graph-to-sequence pretraining in biodegradation pathway prediction The paper develops a graph-to-sequence pretraining framework using rule-generated synthetic reactions to predict chemical biodegradation pathways. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on biodegradation chemical pathways, not LLM benchmarks. | |
| On Global Joint Lower Bounds in Zeroth-Order Nonconvex Optimization The paper proves theoretical joint lower bounds on oracle complexity for zeroth-order nonconvex stochastic optimization. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical nonconvex optimization bounds, not LLM benchmarks. | |
| Annealed Lévy Diffusion via Gaussian Surrogate Reverse Dynamics The paper proposes a generative diffusion framework that anneals heavy-tailed noise into Gaussian noise to combine exploration with stable refinement. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Studies diffusion sampling mathematics, not LLM evaluation benchmarks. | |
| ReGRA: Residual-Gradient Adaptation for Complementary Low-Rank Fine-Tuning The paper introduces a two-stage low-rank fine-tuning method that uses residual gradients to add complementary adaptation directions without expanding the rank. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Introduces a fine-tuning method, not a benchmarking suite. | |
| TIMERSI: Towards Self-Improved Agentic Deployment for Time-Series Foundation Models The paper presents an agentic system that iteratively writes and adjusts forecasting pipelines around frozen time-series models to improve predictions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on automated time-series pipelines, not LLM evaluation benchmarks. | |
| CAST: History-Adaptive Spectral Clipping for LLM Pretraining Introduces an adaptive spectral gradient clipping method to stabilize and accelerate large language model pretraining. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes a pretraining gradient clipping optimizer, not evaluation. | |
| Learning to Compute Is Not Learning to Retain or Reuse in Looped Transformers Investigates why looped transformers fail to retain or reuse earlier correct intermediate states when extended past training depth. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Investigates recurrent transformer mechanics, not LLM evaluation benchmarks. | |
| When Does the Dependency Graph Help Code-to-Architecture Mapping? Evaluates whether dependency graphs improve automated mapping between source code files and system architectures. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Studies software dependency mapping rather than LLM evaluation benchmarks. | |
| From Global to Tail Convergence: Dynamics of $α$-Stable Score-Based Generative Models Provides theoretical convergence bounds for score-based generative models driven by heavy-tailed stable processes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical analysis of score-based models, not LLM benchmarking. | |
| SNACK: A Sequential Notation Framework for Probabilistic Graph Generation Proposes a sequential string notation to represent and generate valid graphs using standard sequence models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on graph generation notation, not LLM benchmarks. | |
| Learning Who Benefits Most: Multi-Treatment Causal Ranking for Population Health Stratification Formulates clinical population health stratification as a multi-treatment causal ranking problem to prioritize interventions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Healthcare causal ranking framework, not LLM benchmark evaluation. | |
| Reinforcement Learning via Advantage Guidance Uses supervised advantage conditioning to train reinforcement learning policies with improved stability. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents a reinforcement learning algorithm, not LLM benchmarks. | |
| Asymptotically Exact Negative Guidance of Diffusion Models via Positive-Unlabeled Learning Applies positive-unlabeled learning to establish mathematically exact negative guidance in diffusion generative models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Covers negative guidance in diffusion models, not LLM evaluation. | |
| Efficient contextual partial monitoring with general function approximation Presents an efficient regression-based algorithm for contextual partial monitoring games with side information. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical bandit and game theory paper, not LLM evaluation. | |
| Calibration and Risk-Budgeted Decisions with System One Models Studies statistical calibration techniques to bound risk when fast language models make automated decisions under uncertainty. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on decision calibration and risk budgeting rather than benchmarks. | |
| When Does Depth Help? Understanding Layerwise Inference in Tabular Foundation Models Analyzes layerwise inference across tabular foundation models to understand how depth and intermediate representations affect predictions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Analyzes internal representations of tabular models, not LLM benchmarking. | |
| JointServe: Serving Multi-Model Agents on Memory-Constrained GPUs Presents a serving system that dynamically manages GPU memory and prefetches weights for multi-model agent workflows. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on memory serving architecture rather than LLM evaluation benchmarks. |
1,081–1,140 of 3,345← PreviousNext →