Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Continuum Attention Replaces discrete attention lookup in transformers with integration over a continuous memory curve to improve validation likelihood. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Introduces a continuous attention mechanism, not an LLM evaluation framework. | |
| Price of Anarchy of First-Price Auctions in Agentic Markets Analyzes the price of anarchy and economic efficiency of first-price auctions where AI agents bid to serve user prompts. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Theoretical analysis of agent auctions, not an empirical LLM benchmark. | |
| Your Transformer Is Secretly Elastic Presents a retraining-free method to adapt transformer sizes dynamically across diverse computational budgets using joint soft pruning of components. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Focuses on dynamic model pruning, not an LLM benchmark. | |
| Co-Evolving Acting and Forecasting for Language Agents Introduces multi-step action forecasting targets alongside actor rollouts to train language agents more effectively from intermediate trajectory steps. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Proposes an agent training method rather than an evaluation benchmark. | |
| Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance Proposes a hierarchical residual policy learning framework to fine-tune mobile robot manipulation policies with decoupled base and arm adjustments. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Presents a policy fine-tuning algorithm, not an LLM benchmark or evaluation. | |
| Modeling and Understanding Neural Weights of Humanoid Policies with Diffusion Generatively models humanoid robot control policy weights using a latent diffusion framework combined with a linear autoencoder and Diffusion Transformer. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | Not relevant Studies generative modeling of robot policy weights, not LLM benchmarks. | |
| Automated Non-Functional Requirements Generation in Software Engineering with Large Language Models: A Comparative Study This paper evaluates the ability of language models to generate non-functional requirements from functional software specifications. Peer-reviewedOlder paper (2025) Older paper (2025) — discussed this week | LLM evaluation and benchmarks via ieee · 15 Oct, 06:19 | Not relevant Empirical study of requirements generation rather than an LLM evaluation benchmark. | |
| REvolution: An Evolutionary Framework for RTL Generation driven by Large Language Models This paper combines evolutionary computation with language models to optimize register-transfer level hardware code for correctness and efficiency. Peer-reviewedOlder paper (2025) Older paper (2025) — discussed this week | LLM evaluation and benchmarks via ieee · 15 Oct, 06:19 | Not relevant Develops a code generation framework rather than a general evaluation benchmark. | |
| Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI This paper introduces specification templates to define operational boundaries, authority, and oversight for autonomous software agents. Peer-reviewedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via acm · 15 Oct, 06:19 | Not relevant Proposes requirements engineering frameworks rather than LLM evaluation benchmarks. | |
| Pristine Models The paper introduces an architecture that separates safe and unsafe visual knowledge during pretraining so unsafe branches can be disabled. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes an architecture for concept unlearning, not evaluation benchmarks. | |
| A Physics-Informed Hybrid Forward-Inverse Machine Learning Framework for High-Dimensional Sparse Recipe Reconstruction The paper proposes a physics-informed forward-inverse machine learning framework for sparse recipe formulation in industrial dyeing. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on chemical dye formulations, not evaluating language models. | |
| From Prototype to Massing: Learning Graph Correspondence for Scalable Facade Modeling The paper develops a graph attention network to transfer prototype facade articulation patterns onto building massing targets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates architectural facade modeling rather than benchmarking language models. | |
| Early Detection of Pension-Sponsor Distress from Public Filings: A Sponsor Vulnerability Index, Stress-Augmented VaR, and Dynamic Self-Investment Caps The paper develops an early-warning pipeline using public balance-sheet filings to predict defined-benefit pension sponsor distress. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on financial distress prediction, not evaluating language models. | |
| Hierarchical Multi-Agent Reasoning Systems for Knowledge-Grounded Material Substitution The paper introduces a hierarchical multi-agent reasoning system combining retrieval and knowledge graphs to find chemical material substitutes. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes a multi-agent domain system, not an LLM evaluation benchmark. | |
| On physical implementability of reinforcement-learning-driven reasoning The paper presents a theoretical negative result on physically implementing reinforcement-learning-driven reasoning in certain physical neural networks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes physical neural network dynamics, not LLM benchmark evaluation. | |
| A Stochastic Analysis Perspective on Diffusion Models The paper provides a stochastic analysis perspective linking score matching, Langevin sampling, and diffusion model time reversal. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Mathematical survey of diffusion models, not LLM benchmark design. | |
| ULPack: Reference-Conditioned Lossless Compression of Checkpoint Trajectories The paper introduces a lossless compression codec for model checkpoint trajectories conditioned on reference floating-point exponents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents a checkpoint compression algorithm, not an LLM benchmark. | |
| Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Data The paper proposes a dynamic stratified grid sampling approach to train implicit neural representations on large scientific data faster. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on scientific implicit neural representations, not LLM benchmark evaluation. | |
| Embedding Graph Kernel Entropy (EGKE): Fine-grained Hallucination Detection for LLMs from Embeddings The paper proposes an embedding-based graph kernel entropy method for computationally efficient hallucination detection in language models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes a hallucination detection method rather than evaluating benchmark trustworthiness. | |
| Learning Non-Gaussian SEMs with Conditional Risk, and Why the Direction of Recursion Matters The paper extends recursive linear structural equation model identification to non-Gaussian noise using conditional prediction risk. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Deals with causal discovery in structural equation models, not LLM evaluation. | |
| Adaptive-Depth Is a Finishing Stage The paper proposes training looped transformers at variable depths only during a short finishing stage to reduce compute costs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on transformer training recipes, not LLM evaluation frameworks. | |
| Do Artificial Neural Networks Need Dendritic Nanotubes? Two Reasons for Shrinking Importance Estimates in Continual Learning The paper examines importance estimate shrinkage to mitigate catastrophic forgetting in regularization-based continual learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates continual learning regularization techniques, not LLM evaluation benchmarks. | |
| Variance Fingerprints: Component-Wise Identification of Content Factors by Augmentation Design The paper establishes theoretical conditions for identifying individual content factors in self-supervised learning via designed augmentation strengths. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical self-supervised learning identifiability paper, not an LLM benchmark. | |
| Learning to Sync at the Edge: Client-Side Adaptive Synchronization for Federated Learning The paper introduces a client-side reinforcement learning scheduler to optimize synchronization decisions in edge federated learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on federated learning communication protocols, not LLM benchmarking. | |
| Layer-wise Input Recoverability in Deep Neural Networks The paper probes convolutional neural networks to measure how much layer input information can be reconstructed from layer outputs. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies CNN layer representations, not LLM benchmarks or evaluation methods. | |
| Learning to See through Action: Predictive Curiosity for Robots The paper proposes an active robot visual learning framework driven by self-supervised curiosity and world model prediction errors. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on robotic curiosity frameworks, not LLM benchmarks or evaluations. | |
| Decentralized Bandit Learning of Markov Perfect Equilibria The paper proves convergence guarantees for decentralized bandit learning in infinite-horizon, general-sum Markov games. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical multi-agent game theory study, not LLM evaluation. | |
| STREGO: A Scalable Implementation of a Trust-Region Framework for Noisy Bayesian Optimization The paper presents a trust-region Bayesian optimization framework designed for noisy, high-dimensional blackbox problems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Optimization framework paper, not an LLM evaluation benchmark. | |
| Continuous-Time Cloth Dynamics with Physics-Informed Neural ODEs The paper presents a continuous-time neural ODE solver for simulating cloth dynamics at arbitrary timestamps. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on neural ODE simulation, not LLM benchmarks or evaluation. | |
| On the Depth Transfer of Neural Optimizers via L-Smoothness The paper analyzes depth transfer of hyperparameters in neural networks using an L-smoothness theoretical framework. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes hyperparameter depth transfer dynamics, not LLM evaluation benchmarks. | |
| Class-Conditional Conformal Prediction for Signal Temporal Logic Inference with Many Classes The paper presents a conformal prediction method to reliably infer Signal Temporal Logic formulas for multiclass time series classification. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Covers conformal prediction for time-series logic, not LLM evaluation benchmarks. | |
| The Sample Complexity of Multicalibration with an ERM Oracle The paper bounds the sample and query complexity of multicalibration using an empirical risk minimization oracle. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical sample complexity study, not about LLM benchmark design or evaluation. | |
| ConformalGuard: False-Positive-Controlled Action Gating for LM Classifiers The paper proposes a conformal calibration layer to provide finite-sample control over false positives in language model classification workflows. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on deployment threshold calibration, not benchmarking or evaluation datasets. | |
| History, Adaptation, and Hidden Gain: Two Prospective Tests of Learned Predictive Control in a Synthetic Neural Population The paper tests predictive neural control against classical controllers in simulated spiking neural populations under varying sensitivity conditions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates neural control systems, not LLM evaluation benchmarks. | |
| When More Memory Fails: Hidden Feasibility Holes in Dynamic Tensor Rematerialization The paper investigates dynamic tensor rematerialization, identifying cases where increasing memory budgets causes training to unexpectedly run out of memory. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates tensor rematerialization behavior, not LLM evaluation benchmarks. | |
| DPAL: A Test-Time Adaptation Loss for Financial Time Series Forecasting The paper presents an adaptation loss incorporating return direction and price trajectory calibration for test-time financial time series forecasting. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on financial time-series loss functions, not LLM evaluation. | |
| Decomposing A Neural Learner The paper proposes a probabilistic decomposition of neural models that separates predictable features from an input-dependent reliability score. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents a general probabilistic framework, not LLM evaluation benchmarks. | |
| Sparse-TD-JEPA: Improving Zero-Shot Reinforcement Learning With Sparse Latent Task Representations The paper applies a sparsity penalty to task representations to sharpen reward signals in zero-shot reinforcement learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Addresses reinforcement learning task representation, not LLM benchmarking. | |
| PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation The paper introduces a backpropagation-free training method for generative relaxation models suitable for analog neuromorphic hardware execution. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes alternative training for vision generation, not LLM evaluation. | |
| From Transfer Probes to Expert Grouping: Evidence from LoRA Post-Training The paper examines using transfer probes to group business tasks when sharing Low-Rank Adaptation experts under fixed parameter budgets. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies expert routing heuristics, not LLM evaluation frameworks. | |
| Learning to Extrapolate in Depth with Looped Transformers The paper studies depth extrapolation in looped transformers for graph connectivity, identifying finite iterations beyond which test performance degrades. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Investigates theoretical transformer depth extrapolation, not LLM benchmarks. | |
| A Gated Catchment Hydrology Model (GCHM) for Physically-Interpretable Rainfall-Evapotranspiration-Runoff Simulation Across Diverse Hydroclimatic Regimes The paper presents a mass-conserving neural network architecture designed for interpretable rainfall, evapotranspiration, and runoff simulation across diverse river catchments. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on catchment hydrology modeling, not LLM evaluation. | |
| DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models The paper introduces an adapter method that disentangles subject identity from task content during downstream fine-tuning of brainwave foundation models. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Evaluates EEG models, not LLM evaluation benchmarks or methodologies. | |
| Identication and Estimation of Nonsymmetric Determinantal Point Processes The paper develops identification theory and asymptotic estimation methods for nonsymmetric determinantal point processes capable of modeling positive dependence. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical statistics on point processes, not LLM evaluation. | |
| Learn the Dynamics, Enforce the Physics: Generative Latent Operators for High-Dimensional Beam Evolution The paper presents a physics-constrained generative latent operator framework to simulate multiscale particle accelerator beam dynamics efficiently. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on particle beam simulation, not LLM benchmarking or evaluation. | |
| PGSB: Pretrained-Guided Shared Basis for LoRA Model Merging The paper proposes a method to align and merge multiple Low-Rank Adaptations using a shared basis guided by pretrained model weights. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Covers LoRA weight merging, not LLM benchmarks or evaluation. | |
| Chunk-wise Model-based Policy Optimization The paper introduces a chunk-wise model-based reinforcement learning approach that uses single-pass rollouts to optimize policies without recurrent backpropagation through time. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Introduces an RL algorithm, not LLM evaluation or benchmarks. | |
| Strong Gaussian Approximation of Constant-Learning-Rate SGD: Bias and Trajectory Inference The paper derives strong Gaussian approximations for constant learning rate stochastic gradient descent under heavy-tailed noise to enable trajectory-level inference. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Theoretical paper on SGD approximations, not LLM evaluation methods. | |
| Dissecting the Carbon-SLO Tension in Geo-Distributed LLM Serving The paper evaluates carbon-aware scheduling for geographically distributed language model serving under strict latency service-level objectives using an empirical simulator. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies serving latency and carbon tradeoffs, not LLM evaluation benchmarks. | |
| LLM-Augmented Bayesian Optimization with Adaptive Policies for Chiplet Design Space Exploration The paper combines language models with Bayesian optimization to guide architectural design exploration for heterogeneous chiplet systems. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Applies LLMs to chiplet design, not LLM evaluation or benchmarking. | |
| From Rainfall to Road-Network Functionality: Transferable Graph Forecasting for Flood-Disrupted Transportation Networks The paper proposes a transferable spatiotemporal graph learning framework to forecast road network disruption caused by extreme rainfall across unseen regions. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on flood road forecasting, not LLM benchmarks or evaluation. | |
| TagBO: LLM-Driven Task-Aware Graph Bayesian Optimization for Scientific Discovery The paper introduces a Bayesian optimization method that combines language model relational priors with structural descriptors for mixed-variable scientific discovery. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Applies LLMs to Bayesian optimization, not LLM benchmarking or testing. | |
| Ascent Conditions for Length-Normalized Single-Rollout Policy Updates The paper analyzes policy gradient updates that divide trajectory scores by length, identifying mathematical conditions under which expected returns can decrease. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes reinforcement learning theoretical bounds, not LLM benchmark evaluation. | |
| Triage-PiEvo: Evidence Admission for Principle-Evolving Scientific Agents The paper presents an evidence admission framework that verifies anomalies before updating the persistent principles of scientific language model agents. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Proposes an evidence admission agent framework, not benchmark evaluation. | |
| One-Way Coupling via Patchwise Adaptive Normalization in Transformer Surrogates The paper proposes patchwise adaptive normalization to represent one-way coupled exogenous fields in transformer surrogates for partial differential equations. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Studies PDE surrogate modeling architectures, not LLM benchmarking methods. | |
| Accelerating Cross-Model LLM Inference via Attention Map Reuse This paper presents a system that speeds up multi-model language model serving by translating and reusing attention maps across models. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Presents an inference serving system, not an LLM benchmark. | |
| Understanding Hidden Spatial Preferences in Bayesian Optimization This paper identifies spatial boundary biases in Bayesian optimization and modifies exploration using parameterized spatial weight fields. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on Bayesian optimization exploration, not LLM evaluation methods. | |
| Linear-Time Non-Local Codec Placement for Machine Learning Model Compression This paper introduces a linear-time algorithm to place codec operators in computational graphs to compress operand traffic during on-device inference. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on codec operator placement algorithms, not LLM benchmarking. | |
| DeKoR: Decomposed Knowledge Routing for Efficient GNN--LLM Fusion This paper proposes a decomposed routing framework that distills large language model knowledge into lightweight graph neural networks. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Focuses on GNN-LLM fusion architectures, not LLM evaluation or benchmarking. | |
| Multi-Token Random-Walk Learning via Meeting-Triggered Information Exchange This paper analyzes the complexity and theoretical benefits of meeting-triggered information exchange in multi-token random-walk decentralized learning. Preprint | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | Not relevant Analyzes decentralized optimization algorithms, not LLM evaluation methodologies. |
1,501–1,560 of 3,345← PreviousNext →