Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Continuum Attention
Replaces discrete attention lookup in transformers with integration over a continuous memory curve to improve validation likelihood.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Introduces a continuous attention mechanism, not an LLM evaluation framework.
Price of Anarchy of First-Price Auctions in Agentic Markets
Analyzes the price of anarchy and economic efficiency of first-price auctions where AI agents bid to serve user prompts.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical analysis of agent auctions, not an empirical LLM benchmark.
Your Transformer Is Secretly Elastic
Presents a retraining-free method to adapt transformer sizes dynamically across diverse computational budgets using joint soft pruning of components.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on dynamic model pruning, not an LLM benchmark.
Co-Evolving Acting and Forecasting for Language Agents
Introduces multi-step action forecasting targets alongside actor rollouts to train language agents more effectively from intermediate trajectory steps.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Proposes an agent training method rather than an evaluation benchmark.
Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance
Proposes a hierarchical residual policy learning framework to fine-tune mobile robot manipulation policies with decoupled base and arm adjustments.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Presents a policy fine-tuning algorithm, not an LLM benchmark or evaluation.
Modeling and Understanding Neural Weights of Humanoid Policies with Diffusion
Generatively models humanoid robot control policy weights using a latent diffusion framework combined with a linear autoencoder and Diffusion Transformer.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 15:06
Not relevant
Studies generative modeling of robot policy weights, not LLM benchmarks.
Automated Non-Functional Requirements Generation in Software Engineering with Large Language Models: A Comparative Study
This paper evaluates the ability of language models to generate non-functional requirements from functional software specifications.
Peer-reviewedOlder paper (2025)
Older paper (2025) — discussed this week
LLM evaluation and benchmarks
via ieee · 15 Oct, 06:19
Not relevant
Empirical study of requirements generation rather than an LLM evaluation benchmark.
REvolution: An Evolutionary Framework for RTL Generation driven by Large Language Models
This paper combines evolutionary computation with language models to optimize register-transfer level hardware code for correctness and efficiency.
Peer-reviewedOlder paper (2025)
Older paper (2025) — discussed this week
LLM evaluation and benchmarks
via ieee · 15 Oct, 06:19
Not relevant
Develops a code generation framework rather than a general evaluation benchmark.
Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI
This paper introduces specification templates to define operational boundaries, authority, and oversight for autonomous software agents.
Peer-reviewedOlder paper (2026)
Older paper (2026) — discussed this week
LLM evaluation and benchmarks
via acm · 15 Oct, 06:19
Not relevant
Proposes requirements engineering frameworks rather than LLM evaluation benchmarks.
Pristine Models
The paper introduces an architecture that separates safe and unsafe visual knowledge during pretraining so unsafe branches can be disabled.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes an architecture for concept unlearning, not evaluation benchmarks.
A Physics-Informed Hybrid Forward-Inverse Machine Learning Framework for High-Dimensional Sparse Recipe Reconstruction
The paper proposes a physics-informed forward-inverse machine learning framework for sparse recipe formulation in industrial dyeing.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on chemical dye formulations, not evaluating language models.
From Prototype to Massing: Learning Graph Correspondence for Scalable Facade Modeling
The paper develops a graph attention network to transfer prototype facade articulation patterns onto building massing targets.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates architectural facade modeling rather than benchmarking language models.
Early Detection of Pension-Sponsor Distress from Public Filings: A Sponsor Vulnerability Index, Stress-Augmented VaR, and Dynamic Self-Investment Caps
The paper develops an early-warning pipeline using public balance-sheet filings to predict defined-benefit pension sponsor distress.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on financial distress prediction, not evaluating language models.
Hierarchical Multi-Agent Reasoning Systems for Knowledge-Grounded Material Substitution
The paper introduces a hierarchical multi-agent reasoning system combining retrieval and knowledge graphs to find chemical material substitutes.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes a multi-agent domain system, not an LLM evaluation benchmark.
On physical implementability of reinforcement-learning-driven reasoning
The paper presents a theoretical negative result on physically implementing reinforcement-learning-driven reasoning in certain physical neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes physical neural network dynamics, not LLM benchmark evaluation.
A Stochastic Analysis Perspective on Diffusion Models
The paper provides a stochastic analysis perspective linking score matching, Langevin sampling, and diffusion model time reversal.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Mathematical survey of diffusion models, not LLM benchmark design.
ULPack: Reference-Conditioned Lossless Compression of Checkpoint Trajectories
The paper introduces a lossless compression codec for model checkpoint trajectories conditioned on reference floating-point exponents.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents a checkpoint compression algorithm, not an LLM benchmark.
Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Data
The paper proposes a dynamic stratified grid sampling approach to train implicit neural representations on large scientific data faster.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on scientific implicit neural representations, not LLM benchmark evaluation.
Embedding Graph Kernel Entropy (EGKE): Fine-grained Hallucination Detection for LLMs from Embeddings
The paper proposes an embedding-based graph kernel entropy method for computationally efficient hallucination detection in language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes a hallucination detection method rather than evaluating benchmark trustworthiness.
Learning Non-Gaussian SEMs with Conditional Risk, and Why the Direction of Recursion Matters
The paper extends recursive linear structural equation model identification to non-Gaussian noise using conditional prediction risk.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Deals with causal discovery in structural equation models, not LLM evaluation.
Adaptive-Depth Is a Finishing Stage
The paper proposes training looped transformers at variable depths only during a short finishing stage to reduce compute costs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on transformer training recipes, not LLM evaluation frameworks.
Do Artificial Neural Networks Need Dendritic Nanotubes? Two Reasons for Shrinking Importance Estimates in Continual Learning
The paper examines importance estimate shrinkage to mitigate catastrophic forgetting in regularization-based continual learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates continual learning regularization techniques, not LLM evaluation benchmarks.
Variance Fingerprints: Component-Wise Identification of Content Factors by Augmentation Design
The paper establishes theoretical conditions for identifying individual content factors in self-supervised learning via designed augmentation strengths.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical self-supervised learning identifiability paper, not an LLM benchmark.
Learning to Sync at the Edge: Client-Side Adaptive Synchronization for Federated Learning
The paper introduces a client-side reinforcement learning scheduler to optimize synchronization decisions in edge federated learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on federated learning communication protocols, not LLM benchmarking.
Layer-wise Input Recoverability in Deep Neural Networks
The paper probes convolutional neural networks to measure how much layer input information can be reconstructed from layer outputs.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies CNN layer representations, not LLM benchmarks or evaluation methods.
Learning to See through Action: Predictive Curiosity for Robots
The paper proposes an active robot visual learning framework driven by self-supervised curiosity and world model prediction errors.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on robotic curiosity frameworks, not LLM benchmarks or evaluations.
Decentralized Bandit Learning of Markov Perfect Equilibria
The paper proves convergence guarantees for decentralized bandit learning in infinite-horizon, general-sum Markov games.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical multi-agent game theory study, not LLM evaluation.
STREGO: A Scalable Implementation of a Trust-Region Framework for Noisy Bayesian Optimization
The paper presents a trust-region Bayesian optimization framework designed for noisy, high-dimensional blackbox problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Optimization framework paper, not an LLM evaluation benchmark.
Continuous-Time Cloth Dynamics with Physics-Informed Neural ODEs
The paper presents a continuous-time neural ODE solver for simulating cloth dynamics at arbitrary timestamps.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on neural ODE simulation, not LLM benchmarks or evaluation.
On the Depth Transfer of Neural Optimizers via L-Smoothness
The paper analyzes depth transfer of hyperparameters in neural networks using an L-smoothness theoretical framework.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes hyperparameter depth transfer dynamics, not LLM evaluation benchmarks.
Class-Conditional Conformal Prediction for Signal Temporal Logic Inference with Many Classes
The paper presents a conformal prediction method to reliably infer Signal Temporal Logic formulas for multiclass time series classification.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Covers conformal prediction for time-series logic, not LLM evaluation benchmarks.
The Sample Complexity of Multicalibration with an ERM Oracle
The paper bounds the sample and query complexity of multicalibration using an empirical risk minimization oracle.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical sample complexity study, not about LLM benchmark design or evaluation.
ConformalGuard: False-Positive-Controlled Action Gating for LM Classifiers
The paper proposes a conformal calibration layer to provide finite-sample control over false positives in language model classification workflows.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on deployment threshold calibration, not benchmarking or evaluation datasets.
History, Adaptation, and Hidden Gain: Two Prospective Tests of Learned Predictive Control in a Synthetic Neural Population
The paper tests predictive neural control against classical controllers in simulated spiking neural populations under varying sensitivity conditions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates neural control systems, not LLM evaluation benchmarks.
When More Memory Fails: Hidden Feasibility Holes in Dynamic Tensor Rematerialization
The paper investigates dynamic tensor rematerialization, identifying cases where increasing memory budgets causes training to unexpectedly run out of memory.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates tensor rematerialization behavior, not LLM evaluation benchmarks.
DPAL: A Test-Time Adaptation Loss for Financial Time Series Forecasting
The paper presents an adaptation loss incorporating return direction and price trajectory calibration for test-time financial time series forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on financial time-series loss functions, not LLM evaluation.
Decomposing A Neural Learner
The paper proposes a probabilistic decomposition of neural models that separates predictable features from an input-dependent reliability score.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents a general probabilistic framework, not LLM evaluation benchmarks.
Sparse-TD-JEPA: Improving Zero-Shot Reinforcement Learning With Sparse Latent Task Representations
The paper applies a sparsity penalty to task representations to sharpen reward signals in zero-shot reinforcement learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Addresses reinforcement learning task representation, not LLM benchmarking.
PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation
The paper introduces a backpropagation-free training method for generative relaxation models suitable for analog neuromorphic hardware execution.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes alternative training for vision generation, not LLM evaluation.
From Transfer Probes to Expert Grouping: Evidence from LoRA Post-Training
The paper examines using transfer probes to group business tasks when sharing Low-Rank Adaptation experts under fixed parameter budgets.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies expert routing heuristics, not LLM evaluation frameworks.
Learning to Extrapolate in Depth with Looped Transformers
The paper studies depth extrapolation in looped transformers for graph connectivity, identifying finite iterations beyond which test performance degrades.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Investigates theoretical transformer depth extrapolation, not LLM benchmarks.
A Gated Catchment Hydrology Model (GCHM) for Physically-Interpretable Rainfall-Evapotranspiration-Runoff Simulation Across Diverse Hydroclimatic Regimes
The paper presents a mass-conserving neural network architecture designed for interpretable rainfall, evapotranspiration, and runoff simulation across diverse river catchments.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on catchment hydrology modeling, not LLM evaluation.
DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models
The paper introduces an adapter method that disentangles subject identity from task content during downstream fine-tuning of brainwave foundation models.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Evaluates EEG models, not LLM evaluation benchmarks or methodologies.
Identication and Estimation of Nonsymmetric Determinantal Point Processes
The paper develops identification theory and asymptotic estimation methods for nonsymmetric determinantal point processes capable of modeling positive dependence.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical statistics on point processes, not LLM evaluation.
Learn the Dynamics, Enforce the Physics: Generative Latent Operators for High-Dimensional Beam Evolution
The paper presents a physics-constrained generative latent operator framework to simulate multiscale particle accelerator beam dynamics efficiently.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on particle beam simulation, not LLM benchmarking or evaluation.
PGSB: Pretrained-Guided Shared Basis for LoRA Model Merging
The paper proposes a method to align and merge multiple Low-Rank Adaptations using a shared basis guided by pretrained model weights.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Covers LoRA weight merging, not LLM benchmarks or evaluation.
Chunk-wise Model-based Policy Optimization
The paper introduces a chunk-wise model-based reinforcement learning approach that uses single-pass rollouts to optimize policies without recurrent backpropagation through time.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Introduces an RL algorithm, not LLM evaluation or benchmarks.
Strong Gaussian Approximation of Constant-Learning-Rate SGD: Bias and Trajectory Inference
The paper derives strong Gaussian approximations for constant learning rate stochastic gradient descent under heavy-tailed noise to enable trajectory-level inference.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Theoretical paper on SGD approximations, not LLM evaluation methods.
Dissecting the Carbon-SLO Tension in Geo-Distributed LLM Serving
The paper evaluates carbon-aware scheduling for geographically distributed language model serving under strict latency service-level objectives using an empirical simulator.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies serving latency and carbon tradeoffs, not LLM evaluation benchmarks.
LLM-Augmented Bayesian Optimization with Adaptive Policies for Chiplet Design Space Exploration
The paper combines language models with Bayesian optimization to guide architectural design exploration for heterogeneous chiplet systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Applies LLMs to chiplet design, not LLM evaluation or benchmarking.
From Rainfall to Road-Network Functionality: Transferable Graph Forecasting for Flood-Disrupted Transportation Networks
The paper proposes a transferable spatiotemporal graph learning framework to forecast road network disruption caused by extreme rainfall across unseen regions.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on flood road forecasting, not LLM benchmarks or evaluation.
TagBO: LLM-Driven Task-Aware Graph Bayesian Optimization for Scientific Discovery
The paper introduces a Bayesian optimization method that combines language model relational priors with structural descriptors for mixed-variable scientific discovery.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Applies LLMs to Bayesian optimization, not LLM benchmarking or testing.
Ascent Conditions for Length-Normalized Single-Rollout Policy Updates
The paper analyzes policy gradient updates that divide trajectory scores by length, identifying mathematical conditions under which expected returns can decrease.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes reinforcement learning theoretical bounds, not LLM benchmark evaluation.
Triage-PiEvo: Evidence Admission for Principle-Evolving Scientific Agents
The paper presents an evidence admission framework that verifies anomalies before updating the persistent principles of scientific language model agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Proposes an evidence admission agent framework, not benchmark evaluation.
One-Way Coupling via Patchwise Adaptive Normalization in Transformer Surrogates
The paper proposes patchwise adaptive normalization to represent one-way coupled exogenous fields in transformer surrogates for partial differential equations.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Studies PDE surrogate modeling architectures, not LLM benchmarking methods.
Accelerating Cross-Model LLM Inference via Attention Map Reuse
This paper presents a system that speeds up multi-model language model serving by translating and reusing attention maps across models.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Presents an inference serving system, not an LLM benchmark.
Understanding Hidden Spatial Preferences in Bayesian Optimization
This paper identifies spatial boundary biases in Bayesian optimization and modifies exploration using parameterized spatial weight fields.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on Bayesian optimization exploration, not LLM evaluation methods.
Linear-Time Non-Local Codec Placement for Machine Learning Model Compression
This paper introduces a linear-time algorithm to place codec operators in computational graphs to compress operand traffic during on-device inference.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on codec operator placement algorithms, not LLM benchmarking.
DeKoR: Decomposed Knowledge Routing for Efficient GNN--LLM Fusion
This paper proposes a decomposed routing framework that distills large language model knowledge into lightweight graph neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Focuses on GNN-LLM fusion architectures, not LLM evaluation or benchmarking.
Multi-Token Random-Walk Learning via Meeting-Triggered Information Exchange
This paper analyzes the complexity and theoretical benefits of meeting-triggered information exchange in multi-token random-walk decentralized learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 15 Oct, 06:18
Not relevant
Analyzes decentralized optimization algorithms, not LLM evaluation methodologies.
1,501–1,560 of 3,345← PreviousNext →