Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates
Analyzes convergence rates of a multi-objective optimization method pairing norm-constrained linear minimization oracles with entropic task-weight updates.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Examines multi-objective optimization algorithms, not language model evaluation or benchmarks.
Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with Constraints
Establishes stochastic first-order and zeroth-order algorithms achieving optimal rates for constrained nonsmooth nonconvex optimization.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents theoretical rates for non-convex stochastic optimization, not LLM evaluation.
Randomized Momentum Transport with Cheap Predictors
Introduces randomized momentum transport to track stochastic gradients using probabilistically sampled transport corrections alongside cheap predictors.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers theoretical momentum optimization algorithms rather than LLM benchmarking or evaluation.
Adaptive Variance Reduction without Knowing Oracle Smoothness
Proposes a two-phase variance reduction method that adapts to average, standard, and noiseless smoothness settings without predefined hyperparameter constants.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
A theoretical optimization paper on variance reduction, not language model evaluation.
Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints
Develops a sequential conditioning framework enabling Gaussian process linear partial differential equation solvers to enforce linear inequality constraints.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents a Gaussian process solver for PDEs, not an LLM benchmark or evaluation study.
Diversity-Aware Ensemble of Quantum-Classical Models via Combinatorial Fusion
Evaluates combinatorial fusion analysis to build diverse ensembles combining classical models and variational quantum circuits for classification tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Proposes a quantum-classical model ensemble technique rather than language model evaluation.
TabMF: Learning Dataset Representations with Tabular Foundation Models
Repurposes pretrained tabular foundation models into supervised dataset encoders using dataset-level readouts and contrastive post-training.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Studies dataset representation learning rather than LLM benchmarks or evaluation methods.
Shared Canonical Component Removal Beyond Expert Views
Presents Shared Canonical Component Removal to quantify predictive information retained by raw machine learning representations beyond predefined expert features.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Investigates feature representation auditing in clinical models, not LLM evaluation or benchmarks.
On the Design Space of Continuous Diffusion Language Models
Investigates training mechanisms in continuous diffusion language models, proposing design modifications for self-conditioning and embedding geometry.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes continuous diffusion architecture design rather than benchmarking or evaluating language models.
Specialists Learn Faster: Knowledge Organization in Pre-training Shapes Knowledge Update Efficiency
Examines how chronological versus shuffled pre-training knowledge sequencing influences the sample efficiency of subsequent model knowledge updates.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on pre-training data ordering dynamics, not LLM benchmark design or evaluation frameworks.
Returning to Development States: When Full Sandbox Snapshots Help Coding Agents
Evaluates full sandbox snapshot exploration for coding agents, finding benefits primarily when recovery requires restoring runtime dependencies outside Git repositories.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
It does not introduce or study general LLM evaluation benchmarks or assessment methodology.
Inference-Time Steering Across Scaffolds and Epitopes for Sample-Efficient De Novo Nanobody Design
Applies dynamic budget allocation algorithms at inference time to select scaffolds and epitopes during de novo nanobody generative design.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Covers molecular design inference steering, not LLM evaluation benchmarks.
Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models
Derives finite-sample convergence guarantees for fully discrete conditional diffusion models with finitely many denoising steps under smooth density assumptions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical statistical estimation bounds for diffusion models, not LLM evaluation.
Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking
Introduces PISO, an optimization framework that combines partially available gradients with zeroth-order residual tracking to reduce variance from random probing.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Presents theoretical stochastic optimization algorithms, not LLM benchmarking.
Prediction Is Not a Sufficient Memory State
Analyzes the dimensional requirements of exact recurrent memory states for cumulative learning under convex residual loss functions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical characterization of cumulative learning memory states, not LLM evaluation.
Hitting-Time Bounds for Asynchronous Q-Learning
Establishes finite-time error bounds for single-trajectory asynchronous Q-learning that incorporate the hitting time of the underlying Markov decision process.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical convergence bounds for asynchronous Q-learning, not LLM benchmarks.
Designing Protein Structures from Natural Language
Introduces Prompteina, an all-atom generative model and dataset for generating de novo protein structures conditioned on natural language prompts.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on protein structure generation from text prompts, not LLM evaluation methods.
DyssomniaNN: Multi-Scale Spiking Neural Modeling of Human Sleep Disorders and Perceived Restedness
Develops a multi-scale biophysical spiking neural network model to simulate sleep-wake regulation and discrepancies between objective sleep and subjective restedness.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Deals with computational neuroscience and sleep modeling, not LLM evaluation.
Goal-Oriented Bundle Management and Flow Control for Deep-Space Communications via Reinforcement Learning
Applies reinforcement learning to manage bundle scheduling and flow control at relay nodes in deep-space communication networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on deep-space communication networking via RL, not LLM evaluation.
KL Before and After Mixing: A Round-Complexity Separation in Parallel Sampling
Analyzes round complexity in parallel coordinate samplers, proving a separation between schedule-averaged and output-law Kullback-Leibler divergences.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical analysis of parallel sampling divergences, not LLM benchmarks or evaluation.
Constructive Bounds for the Topological Expressivity of Neural Networks
Proves upper bounds on the topological expressivity of neural networks measured by the Betti numbers of their output spaces.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical math paper on topological expressivity, not LLM evaluation or benchmarks.
Open-Vocabulary Audio-Visual Event Localization via Complex-Valued Fusion
The paper proposes a complex-valued neural network to fuse audio and visual similarity streams for open-vocabulary audio-visual event localization.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a new fusion architecture, not an evaluation framework or benchmark study.
Revisiting Identity and Spectra Dispersion in Media-Bridged Time Series Forecasting: Linking Multivariate Signals and Narrative Flows
The paper proposes MIDAPN, a unified spatiotemporal network using identity-aware graphs and temporal learning across numerical and narrative-flow time series.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a model architecture rather than a benchmarking or evaluation study.
DVLA-RL++: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning
The paper presents DVLA-RL++, combining complementary semantic purification and reinforcement learning gating to reduce context contamination in few-shot learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a model architecture, not a new evaluation benchmark or measurement framework.
Few-Step Generation via Data-Space Iteration
The paper proposes data-space iteration, a few-step generative method removing flow discretization by directly refining noise predictions in data space.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an algorithmic sampling method, not a general evaluation methodology or benchmark.
Just Weather Scoring: Efficient End-to-end Nowcasting with Distributional Diffusion
Introduces an end-to-end diffusion model operating directly in radar space for few-step probabilistic precipitation nowcasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Deals with weather nowcasting rather than LLM evaluation or benchmarking methods.
Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching
Presents a dense correspondence framework combining generative and semantic representations to handle non-rigid image editing and generation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on dense correspondence matching techniques rather than general LLM evaluation benchmarks.
One Block, Multiple Depths: Recurrent Vision Transformers with Depth-Programmed Experts
Designs a vision transformer using a single recurrent block with depth-programmed experts to reduce stored parameters without accuracy loss.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a recurrent architecture rather than an LLM evaluation methodology or benchmark.
Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback
Presents an embodied coding agent framework using active physical and visual probing to refine aerial manipulation policies.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an aerial agent framework rather than general LLM evaluation benchmarks.
Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation
Evaluates explainability methods across CNN, ViT, and Mamba models using eye-tracking gaze data as ground truth.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Investigates explainability methods using gaze alignment, not LLM evaluation benchmarks.
Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction
Proposes a hybrid linear and sparse attention framework to accelerate feed-forward 3D foundation models across many views.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces an efficient model architecture rather than benchmark evaluation frameworks.
StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras
Synthesizes stereo manipulation data from monocular robot demonstrations using estimated depth and video diffusion models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents data generation techniques for robotics rather than LLM/AI evaluation benchmarks.
Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability
Develops a kernelized parameter sensitivity atlas to amortize input-specific gradient attribution across vision, forecasting, and biology models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an interpretability attribution method rather than a general LLM evaluation benchmark.
APEX: Asynchronous Prefix Denoising for Extreme Compression
Introduces an asynchronous prefix denoising framework for extreme latent compression in diffusion models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a generative architecture rather than evaluation methodologies or benchmarks.
BLEND: Balancing Personalization vs. Generalization in Federated Vision-Language Models
Introduces a federated vision-language model tuning framework combining global shared adapters with client-specific personalized projection adapters.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on a federated fine-tuning framework rather than new LLM/VLM evaluation or benchmarks.
Golden Anchor for Video Generation
Studies how text-to-image anchor properties correlate with downstream video generation quality in image-to-video diffusion pipelines.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes video quality metrics and reward models, not LLM evaluation benchmarks.
The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging
Audits joint-embedding predictive learning in medical CT scans, showing a bias that degrades performance on unpredictable localized pathology.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Audits representation bias in predictive learning rather than proposing an LLM evaluation benchmark.
CV-OPD: Contrastive Vision On-policy Distillation
Introduces Contrastive Vision On-policy Distillation to prevent vision-language models from relying on answer shortcuts rather than visual evidence.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a training distillation method, not a new evaluation benchmark or LLM evaluation framework.
Decoding Register Tokens Preserves Global Scene Details
Investigates decoding register tokens alongside patch tokens in vision transformers to preserve global scene appearance details.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Investigates ViT internal token mechanics rather than LLM evaluation benchmarks.
Sonic-AMG: Streaming Human Motion Generation from Spatial Audio
Introduces a streaming causal transformer framework for generating human motion continuously from spatial audio inputs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops a motion generation framework rather than LLM evaluation or benchmarks.
RARA: Robust Policy Fine-Tuning through Retrieval-Anchored Representation Alignment for Robotic Manipulation
Aligns robot policy representations with retrieved pretraining examples to maintain generalization during low-data fine-tuning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on policy fine-tuning techniques rather than LLM benchmarks or evaluation methods.
X-AVDD: Cross-Attentive Audio-Visual Dataset Distillation
Proposes a memory-efficient cross-attention method for distilling large paired audio-visual datasets into compact synthetic sets.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on synthetic dataset distillation for training efficiency rather than evaluating or benchmarking LLMs.
Shortcut Learning in Geospatial Foundation Model Embeddings for Cross-Disaster Damage Assessment
Evaluates shortcut learning and out-of-distribution failure in geospatial foundation models on cross-disaster damage assessment tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates geospatial foundation models on disaster datasets, not LLM evaluation and benchmarking.
Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning
Presents a unified plug-and-play posterior sampling framework combining diffusion and flow models via exact Gaussian conditioning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a sampling method for inverse problems, not LLM benchmark evaluation.
Dream to Remember: Continual Steering of Generalist Robot Policies with World Models
Uses a frozen world model to continually steer generalist robot policies onto new tasks without catastrophic forgetting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on continual robot policy steering rather than evaluating general LLM benchmarks.
Could LLM Watermark Detection be Public?
Evaluates public LLM watermark detectors and introduces a split-key mechanism combining public detection with private verification.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes public watermarking mechanisms, not a broader benchmark or evaluation framework for LLMs.
Poster: A Preliminary Study of LLM Distillation Inference
Presents a hypothesis testing framework using shadow models to audit whether a language model was distilled from a proprietary teacher.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on detecting distillation attacks via hypothesis tests rather than general model evaluation methods.
Verification with Transfer: Exact Information Frontiers and Their Price in Calls
Establishes information bounds and query complexity frontiers for verifying answers when transferring hints from related source tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Theoretical information-theoretic study of verification protocols, not LLM benchmarks or evaluation frameworks.
PVBRF-ID: Private, Verifiable and Byzantine-Robust Federated Intrusion Detection for Oilfield Enterprise Networks
The paper presents a two-server federated learning protocol using secret sharing and public verification to defend against poisoning attacks in industrial networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates a federated protocol on Edge-IIoTset, not proposing new general LLM evaluation benchmarks.
Byzantine-Resilient Federated Large Language Model via Hypergraph Message Passing
The paper introduces a hypergraph autoencoder framework to filter malicious model updates and preserve Byzantine resilience in federated large language models.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on robust federated aggregation against Byzantine attacks, not benchmarking or evaluating LLMs.
Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors
The paper evaluates label-only backdoor defenses and demonstrates that inspecting representations in unpoisoned feature spaces improves poison detection accuracy.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on auditing backdoor attacks rather than general LLM evaluation benchmarks.
The Limits of Query Monitoring against Distributed Model Extraction
The paper evaluates the theoretical and empirical limits of using query monitoring to detect distributed model extraction campaigns among ordinary users.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on extraction detection monitoring rather than LLM benchmarking or evaluation frameworks.
Structured Sentiment Analysis Using Sequence Labeling as Dependency Graph Parsing
The paper models structured sentiment analysis as dependency graph parsing implemented through sequence labeling across five languages.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates existing sentiment benchmarks rather than contributing a new benchmark or evaluation method.
4-Tensor Attention Model for Semantic Physical Reality
The paper proposes a four-tensor attention architecture that jointly normalizes attention over semantic and temporal fibers for scene prediction.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces an architectural model rather than an LLM evaluation benchmark.
DPPM: Dual-Path Parametric Memory for Personalized Language Models
The paper introduces a dual-path parametric memory method that combines pooled history representations with sequential adapter updates.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a memory mechanism rather than a new general LLM evaluation methodology.
From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment
The paper proposes a sparse factor framework to map multimodal behavioral data to interpretable concepts for depression assessment.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a domain-specific diagnostic architecture rather than generic LLM benchmarking.
Easy to anticipate, hard to compute: boundary dependence finds the computed outputs that entropy patching misses
The paper demonstrates that entropy-based byte patching misses predictable calculation points and proposes a boundary-dependence signal to fix it.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes patch layout mechanisms rather than creating an LLM evaluation benchmark.
Detecting Spin in Clinical Trials with Large Language Models
The paper develops an LLM-based pipeline to automatically detect outcome switching and presentation spin in clinical trial reports.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an applied classification system rather than a general LLM evaluation benchmark.
Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning
The paper introduces a method to unlearn target knowledge while recovering collateral capability loss in non-target tasks.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an unlearning framework rather than a new evaluation benchmark or audit methodology.
Event-Centric Memory with Query-Aware Graph Augmentation for Long-Term Conversational Agents
The paper proposes an event-centric memory framework that converts dialogue history into query-relevant graph working memory for conversational agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a memory architecture rather than a generic LLM benchmark or evaluation study.
3,001–3,060 of 3,345← PreviousNext →