Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates Analyzes convergence rates of a multi-objective optimization method pairing norm-constrained linear minimization oracles with entropic task-weight updates. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Examines multi-objective optimization algorithms, not language model evaluation or benchmarks. | |
| Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with Constraints Establishes stochastic first-order and zeroth-order algorithms achieving optimal rates for constrained nonsmooth nonconvex optimization. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents theoretical rates for non-convex stochastic optimization, not LLM evaluation. | |
| Randomized Momentum Transport with Cheap Predictors Introduces randomized momentum transport to track stochastic gradients using probabilistically sampled transport corrections alongside cheap predictors. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Covers theoretical momentum optimization algorithms rather than LLM benchmarking or evaluation. | |
| Adaptive Variance Reduction without Knowing Oracle Smoothness Proposes a two-phase variance reduction method that adapts to average, standard, and noiseless smoothness settings without predefined hyperparameter constants. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant A theoretical optimization paper on variance reduction, not language model evaluation. | |
| Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints Develops a sequential conditioning framework enabling Gaussian process linear partial differential equation solvers to enforce linear inequality constraints. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents a Gaussian process solver for PDEs, not an LLM benchmark or evaluation study. | |
| Diversity-Aware Ensemble of Quantum-Classical Models via Combinatorial Fusion Evaluates combinatorial fusion analysis to build diverse ensembles combining classical models and variational quantum circuits for classification tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Proposes a quantum-classical model ensemble technique rather than language model evaluation. | |
| TabMF: Learning Dataset Representations with Tabular Foundation Models Repurposes pretrained tabular foundation models into supervised dataset encoders using dataset-level readouts and contrastive post-training. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Studies dataset representation learning rather than LLM benchmarks or evaluation methods. | |
| Shared Canonical Component Removal Beyond Expert Views Presents Shared Canonical Component Removal to quantify predictive information retained by raw machine learning representations beyond predefined expert features. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Investigates feature representation auditing in clinical models, not LLM evaluation or benchmarks. | |
| On the Design Space of Continuous Diffusion Language Models Investigates training mechanisms in continuous diffusion language models, proposing design modifications for self-conditioning and embedding geometry. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Analyzes continuous diffusion architecture design rather than benchmarking or evaluating language models. | |
| Specialists Learn Faster: Knowledge Organization in Pre-training Shapes Knowledge Update Efficiency Examines how chronological versus shuffled pre-training knowledge sequencing influences the sample efficiency of subsequent model knowledge updates. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on pre-training data ordering dynamics, not LLM benchmark design or evaluation frameworks. | |
| Returning to Development States: When Full Sandbox Snapshots Help Coding Agents Evaluates full sandbox snapshot exploration for coding agents, finding benefits primarily when recovery requires restoring runtime dependencies outside Git repositories. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant It does not introduce or study general LLM evaluation benchmarks or assessment methodology. | |
| Inference-Time Steering Across Scaffolds and Epitopes for Sample-Efficient De Novo Nanobody Design Applies dynamic budget allocation algorithms at inference time to select scaffolds and epitopes during de novo nanobody generative design. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Covers molecular design inference steering, not LLM evaluation benchmarks. | |
| Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models Derives finite-sample convergence guarantees for fully discrete conditional diffusion models with finitely many denoising steps under smooth density assumptions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical statistical estimation bounds for diffusion models, not LLM evaluation. | |
| Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking Introduces PISO, an optimization framework that combines partially available gradients with zeroth-order residual tracking to reduce variance from random probing. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Presents theoretical stochastic optimization algorithms, not LLM benchmarking. | |
| Prediction Is Not a Sufficient Memory State Analyzes the dimensional requirements of exact recurrent memory states for cumulative learning under convex residual loss functions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical characterization of cumulative learning memory states, not LLM evaluation. | |
| Hitting-Time Bounds for Asynchronous Q-Learning Establishes finite-time error bounds for single-trajectory asynchronous Q-learning that incorporate the hitting time of the underlying Markov decision process. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical convergence bounds for asynchronous Q-learning, not LLM benchmarks. | |
| Designing Protein Structures from Natural Language Introduces Prompteina, an all-atom generative model and dataset for generating de novo protein structures conditioned on natural language prompts. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on protein structure generation from text prompts, not LLM evaluation methods. | |
| DyssomniaNN: Multi-Scale Spiking Neural Modeling of Human Sleep Disorders and Perceived Restedness Develops a multi-scale biophysical spiking neural network model to simulate sleep-wake regulation and discrepancies between objective sleep and subjective restedness. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Deals with computational neuroscience and sleep modeling, not LLM evaluation. | |
| Goal-Oriented Bundle Management and Flow Control for Deep-Space Communications via Reinforcement Learning Applies reinforcement learning to manage bundle scheduling and flow control at relay nodes in deep-space communication networks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Focuses on deep-space communication networking via RL, not LLM evaluation. | |
| KL Before and After Mixing: A Round-Complexity Separation in Parallel Sampling Analyzes round complexity in parallel coordinate samplers, proving a separation between schedule-averaged and output-law Kullback-Leibler divergences. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical analysis of parallel sampling divergences, not LLM benchmarks or evaluation. | |
| Constructive Bounds for the Topological Expressivity of Neural Networks Proves upper bounds on the topological expressivity of neural networks measured by the Betti numbers of their output spaces. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | Not relevant Theoretical math paper on topological expressivity, not LLM evaluation or benchmarks. | |
| Open-Vocabulary Audio-Visual Event Localization via Complex-Valued Fusion The paper proposes a complex-valued neural network to fuse audio and visual similarity streams for open-vocabulary audio-visual event localization. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a new fusion architecture, not an evaluation framework or benchmark study. | |
| Revisiting Identity and Spectra Dispersion in Media-Bridged Time Series Forecasting: Linking Multivariate Signals and Narrative Flows The paper proposes MIDAPN, a unified spatiotemporal network using identity-aware graphs and temporal learning across numerical and narrative-flow time series. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a model architecture rather than a benchmarking or evaluation study. | |
| DVLA-RL++: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning The paper presents DVLA-RL++, combining complementary semantic purification and reinforcement learning gating to reduce context contamination in few-shot learning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a model architecture, not a new evaluation benchmark or measurement framework. | |
| Few-Step Generation via Data-Space Iteration The paper proposes data-space iteration, a few-step generative method removing flow discretization by directly refining noise predictions in data space. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an algorithmic sampling method, not a general evaluation methodology or benchmark. | |
| Just Weather Scoring: Efficient End-to-end Nowcasting with Distributional Diffusion Introduces an end-to-end diffusion model operating directly in radar space for few-step probabilistic precipitation nowcasting. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Deals with weather nowcasting rather than LLM evaluation or benchmarking methods. | |
| Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching Presents a dense correspondence framework combining generative and semantic representations to handle non-rigid image editing and generation. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on dense correspondence matching techniques rather than general LLM evaluation benchmarks. | |
| One Block, Multiple Depths: Recurrent Vision Transformers with Depth-Programmed Experts Designs a vision transformer using a single recurrent block with depth-programmed experts to reduce stored parameters without accuracy loss. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a recurrent architecture rather than an LLM evaluation methodology or benchmark. | |
| Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback Presents an embodied coding agent framework using active physical and visual probing to refine aerial manipulation policies. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an aerial agent framework rather than general LLM evaluation benchmarks. | |
| Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation Evaluates explainability methods across CNN, ViT, and Mamba models using eye-tracking gaze data as ground truth. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Investigates explainability methods using gaze alignment, not LLM evaluation benchmarks. | |
| Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction Proposes a hybrid linear and sparse attention framework to accelerate feed-forward 3D foundation models across many views. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces an efficient model architecture rather than benchmark evaluation frameworks. | |
| StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras Synthesizes stereo manipulation data from monocular robot demonstrations using estimated depth and video diffusion models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents data generation techniques for robotics rather than LLM/AI evaluation benchmarks. | |
| Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability Develops a kernelized parameter sensitivity atlas to amortize input-specific gradient attribution across vision, forecasting, and biology models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an interpretability attribution method rather than a general LLM evaluation benchmark. | |
| APEX: Asynchronous Prefix Denoising for Extreme Compression Introduces an asynchronous prefix denoising framework for extreme latent compression in diffusion models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a generative architecture rather than evaluation methodologies or benchmarks. | |
| BLEND: Balancing Personalization vs. Generalization in Federated Vision-Language Models Introduces a federated vision-language model tuning framework combining global shared adapters with client-specific personalized projection adapters. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on a federated fine-tuning framework rather than new LLM/VLM evaluation or benchmarks. | |
| Golden Anchor for Video Generation Studies how text-to-image anchor properties correlate with downstream video generation quality in image-to-video diffusion pipelines. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes video quality metrics and reward models, not LLM evaluation benchmarks. | |
| The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging Audits joint-embedding predictive learning in medical CT scans, showing a bias that degrades performance on unpredictable localized pathology. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Audits representation bias in predictive learning rather than proposing an LLM evaluation benchmark. | |
| CV-OPD: Contrastive Vision On-policy Distillation Introduces Contrastive Vision On-policy Distillation to prevent vision-language models from relying on answer shortcuts rather than visual evidence. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a training distillation method, not a new evaluation benchmark or LLM evaluation framework. | |
| Decoding Register Tokens Preserves Global Scene Details Investigates decoding register tokens alongside patch tokens in vision transformers to preserve global scene appearance details. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Investigates ViT internal token mechanics rather than LLM evaluation benchmarks. | |
| Sonic-AMG: Streaming Human Motion Generation from Spatial Audio Introduces a streaming causal transformer framework for generating human motion continuously from spatial audio inputs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops a motion generation framework rather than LLM evaluation or benchmarks. | |
| RARA: Robust Policy Fine-Tuning through Retrieval-Anchored Representation Alignment for Robotic Manipulation Aligns robot policy representations with retrieved pretraining examples to maintain generalization during low-data fine-tuning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on policy fine-tuning techniques rather than LLM benchmarks or evaluation methods. | |
| X-AVDD: Cross-Attentive Audio-Visual Dataset Distillation Proposes a memory-efficient cross-attention method for distilling large paired audio-visual datasets into compact synthetic sets. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on synthetic dataset distillation for training efficiency rather than evaluating or benchmarking LLMs. | |
| Shortcut Learning in Geospatial Foundation Model Embeddings for Cross-Disaster Damage Assessment Evaluates shortcut learning and out-of-distribution failure in geospatial foundation models on cross-disaster damage assessment tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates geospatial foundation models on disaster datasets, not LLM evaluation and benchmarking. | |
| Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning Presents a unified plug-and-play posterior sampling framework combining diffusion and flow models via exact Gaussian conditioning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a sampling method for inverse problems, not LLM benchmark evaluation. | |
| Dream to Remember: Continual Steering of Generalist Robot Policies with World Models Uses a frozen world model to continually steer generalist robot policies onto new tasks without catastrophic forgetting. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on continual robot policy steering rather than evaluating general LLM benchmarks. | |
| Could LLM Watermark Detection be Public? Evaluates public LLM watermark detectors and introduces a split-key mechanism combining public detection with private verification. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes public watermarking mechanisms, not a broader benchmark or evaluation framework for LLMs. | |
| Poster: A Preliminary Study of LLM Distillation Inference Presents a hypothesis testing framework using shadow models to audit whether a language model was distilled from a proprietary teacher. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on detecting distillation attacks via hypothesis tests rather than general model evaluation methods. | |
| Verification with Transfer: Exact Information Frontiers and Their Price in Calls Establishes information bounds and query complexity frontiers for verifying answers when transferring hints from related source tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Theoretical information-theoretic study of verification protocols, not LLM benchmarks or evaluation frameworks. | |
| PVBRF-ID: Private, Verifiable and Byzantine-Robust Federated Intrusion Detection for Oilfield Enterprise Networks The paper presents a two-server federated learning protocol using secret sharing and public verification to defend against poisoning attacks in industrial networks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates a federated protocol on Edge-IIoTset, not proposing new general LLM evaluation benchmarks. | |
| Byzantine-Resilient Federated Large Language Model via Hypergraph Message Passing The paper introduces a hypergraph autoencoder framework to filter malicious model updates and preserve Byzantine resilience in federated large language models. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on robust federated aggregation against Byzantine attacks, not benchmarking or evaluating LLMs. | |
| Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors The paper evaluates label-only backdoor defenses and demonstrates that inspecting representations in unpoisoned feature spaces improves poison detection accuracy. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on auditing backdoor attacks rather than general LLM evaluation benchmarks. | |
| The Limits of Query Monitoring against Distributed Model Extraction The paper evaluates the theoretical and empirical limits of using query monitoring to detect distributed model extraction campaigns among ordinary users. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on extraction detection monitoring rather than LLM benchmarking or evaluation frameworks. | |
| Structured Sentiment Analysis Using Sequence Labeling as Dependency Graph Parsing The paper models structured sentiment analysis as dependency graph parsing implemented through sequence labeling across five languages. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates existing sentiment benchmarks rather than contributing a new benchmark or evaluation method. | |
| 4-Tensor Attention Model for Semantic Physical Reality The paper proposes a four-tensor attention architecture that jointly normalizes attention over semantic and temporal fibers for scene prediction. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces an architectural model rather than an LLM evaluation benchmark. | |
| DPPM: Dual-Path Parametric Memory for Personalized Language Models The paper introduces a dual-path parametric memory method that combines pooled history representations with sequential adapter updates. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a memory mechanism rather than a new general LLM evaluation methodology. | |
| From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment The paper proposes a sparse factor framework to map multimodal behavioral data to interpretable concepts for depression assessment. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a domain-specific diagnostic architecture rather than generic LLM benchmarking. | |
| Easy to anticipate, hard to compute: boundary dependence finds the computed outputs that entropy patching misses The paper demonstrates that entropy-based byte patching misses predictable calculation points and proposes a boundary-dependence signal to fix it. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes patch layout mechanisms rather than creating an LLM evaluation benchmark. | |
| Detecting Spin in Clinical Trials with Large Language Models The paper develops an LLM-based pipeline to automatically detect outcome switching and presentation spin in clinical trial reports. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an applied classification system rather than a general LLM evaluation benchmark. | |
| Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning The paper introduces a method to unlearn target knowledge while recovering collateral capability loss in non-target tasks. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an unlearning framework rather than a new evaluation benchmark or audit methodology. | |
| Event-Centric Memory with Query-Aware Graph Augmentation for Long-Term Conversational Agents The paper proposes an event-centric memory framework that converts dialogue history into query-relevant graph working memory for conversational agents. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a memory architecture rather than a generic LLM benchmark or evaluation study. |
3,001–3,060 of 3,345← PreviousNext →