Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
Lethe: Link Inference Attacks For Evaluation of Edge Unlearning Methods
This paper presents a benchmark and link inference attack framework to evaluate edge unlearning methods in graph neural networks.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Benchmarking is for graph edge unlearning, not language models.
Learning Lean Feedback for Efficient Proof-Candidate Evaluation on GPUs
This paper trains GPU-based neural evaluators to predict Lean 4 compiler verdicts and feedback, accelerating proof-candidate filtering.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Develops neural evaluators for Lean proofs, not general LLM benchmarks.
Graph Dirichlet Energy for Fitting-Free Bivariate Causal Inference
This paper proposes a Dirichlet energy criterion on kernel similarity graphs for bivariate causal inference without regression fitting or independence testing.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on bivariate causal discovery, not LLM evaluation.
Self-Calibrated Subspace Robust PCA for Parameter-Free Removal of Mixed Noise and Line Stripes in Hyperspectral Images
This paper presents a self-calibrated robust PCA method for removing mixed noise and line stripes in hyperspectral images without preset parameters.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Covers hyperspectral image denoising, not LLM evaluation.
The Tilted Sampling Problem: Optimism, Posterior Sampling, and Logarithmic Regret
This paper formulates tilted sampling as an online learning problem for sampling from Gibbs distributions and establishes logarithmic regret bounds.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on online learning regret theory, not LLM benchmarks.
The Lagrangian Structure of Cost-Penalized Active Feature Acquisition
This paper analyzes the theoretical Lagrangian structure of cost-penalized heuristics in active feature acquisition under hard budget constraints.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Studies active feature acquisition theory, not LLM evaluation.
SelectPFN: Amortized Bayesian Variable Selection for Sparse Nonlinear Regression with Prior-Data Fitted Networks
This paper introduces a prior-data fitted network that performs simultaneous Bayesian variable selection and nonlinear prediction in a single forward pass.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Examines tabular Bayesian variable selection, not LLM evaluation.
ChronoSheaf: Joint Spatio-Temporal Spectral Filtering on Cellular Sheaves
This paper introduces a spatio-temporal spectral sheaf Laplacian and filter to jointly capture space and time dependencies on graphs.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Proposes spatio-temporal sheaf networks, not LLM evaluation.
Uncertainty-Aware Federated Learning for Joint Communication and Computation in XR Systems
This paper presents an uncertainty-aware federated learning method to manage power and computing allocation for extended reality devices under state uncertainties.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Examines wireless communication and computation, not LLM evaluation.
Learn Only Where You Can't Compute: Structured Corrections to Gaussian Process Posteriors
This paper combines Gaussian process references with targeted diffusion model corrections to infer scientific physical fields from sparse data.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on Gaussian processes and diffusion, not LLM evaluation.
Deep Learning of Topological Equivalence Classes
This paper applies deep learning to classify topological equivalence classes of finite group actions on Riemann surfaces.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Studies Riemann surface group actions, not LLM evaluation.
Interfaces and Modules: A Scalable Representation for Weight-Space Learning across Architectures
This paper introduces an interface-based graph representation and encoder for scalable weight-space learning across diverse neural network architectures.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on weight-space representation learning, not LLM evaluation.
Stateful Testing for Deep Learning Compilers
This paper introduces a stateful testing method to detect bugs in deep learning compilers caused by retained state across invocations.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on software compiler testing rather than LLM benchmarks.
Close Enough is Nowhere Near: Fidelity-Consumability Decoupling in KV Caches
This paper investigates direct key-value cache substitution between frozen language models and finds geometric similarity fails to ensure consumability.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Analyzes KV cache substitution, not evaluation methodology or benchmarks.
Not All Unlabeled Data Are Equal: Unlabeled Data Selection for Semi-Supervised QSAR Modeling with Large Chemical Repositories
This paper investigates unlabeled data selection strategies for semi-supervised QSAR modeling using large chemical repositories.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Investigates semi-supervised learning for chemistry, not LLM evaluation.
Augment the Cache, Replace the Activation: A 2x2 Study of Internal-State Sharing
This paper explores internal-state sharing in multi-agent language models through a central pool rather than pairwise transfer bridges.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Studies multi-agent internal state communication, not LLM evaluation.
Designing Experiments for External Decision Makers
This paper introduces usage-aware Bayesian experimental design to minimize risk when experimental data is processed by unknown or external decision makers.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Covers theoretical Bayesian experimental design, not LLM benchmarks.
ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models
This paper presents a pipeline parallelism training system that balances data workloads across heterogeneous hardware while reducing communication overhead.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Addresses distributed model training, not LLM evaluation or benchmarks.
Missed Detections and False Alarms in a CNN Technosignature Detector on Breakthrough Listen Data
This paper tests a convolutional neural network technosignature detector against synthetic injections in real radio data to reveal out-of-distribution failure modes.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on radio technosignature CNN detectors, not LLM evaluation.
Rethinking Successive Rejects Algorithms
This paper optimizes the predefined phase-length schedules of Successive Rejects algorithms to improve error exponents in fixed-budget best-arm identification.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Theoretical multi-armed bandit algorithm analysis, not language model evaluation.
ABNAT: Attention-Based Noise-Aware Training for Robust Transformers on Analog Compute-in-Memory Systems
This paper proposes an attention-based noise-aware training method to improve the robustness of Transformer models deployed on analog compute-in-memory hardware.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on hardware noise-aware training, not LLM benchmark evaluation.
Can AI Forecast the Extremes? Evaluating Probabilistic Weather Models on Tropical Cyclones
This paper evaluates probabilistic AI weather forecasting models against operational physics-based ensembles on tropical cyclone tracking, intensity, and structure.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Evaluates meteorological weather models, not language models or LLM-as-a-judge.
Learning Changes the World and Then What Was Learned has Changed: Training and Deploying Neural Networks in the Control Loop
This paper categorizes failure modes when deploying neural networks in closed-loop control systems and proposes online adaptation policies to counter distribution shifts.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on control-loop dynamical error analysis, not LLM evaluation.
Scene Reconstruction Using Ubiquitous Wireless Signals via Diffusion Posterior Inference Over physics-Grounded Representations
This paper presents a diffusion-based posterior inference framework to reconstruct physical scenes from ubiquitous wireless channel measurements.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on RF-based 3D scene reconstruction, not language model evaluation.
Beyond Fixed Acquisition Functions: Temporal Difference Active Learning for Perturbation Discovery
This paper introduces a temporal difference active learning framework to adaptively learn experiment selection policies for budgeted perturbation discovery.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on biological perturbation active learning, not LLM evaluation benchmarks.
The importance of tensor handling and implementation of physics-informed DeepONets
Reorganizes tensor operations in physics-informed DeepONet architectures to eliminate redundancy and reduce training costs for higher-dimensional problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on physics-informed neural network architectures, not LLM benchmarks.
LCT: Losslessly Compressed Tensors with GPU friendly execution for Training
Provides a GPU-accelerated Huffman compression framework for tensors to lower memory overhead during model training.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on GPU tensor compression systems, not LLM benchmark evaluation.
Attention over noisy examples: generalization and memorization in the exponential Hopfield network
Analyzes generalization and memorization dynamics in exponential Hopfield networks trained with softmax attention over noisy examples.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Statistical physics analysis of Hopfield networks, not LLM evaluation benchmarks.
Generalization Guarantees of Randomized Block Coordinate Descent for Nonconvex Learning
Derives theoretical high-probability generalization guarantees and early stopping bounds for randomized block coordinate descent on nonconvex problems.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Theoretical nonconvex optimization analysis, not LLM evaluation or benchmarking.
Architecting for Hardware Diversity: Meta's End-to-End Co-Design for High-Performance AI Training on AMD GPUs
Shares hardware-model co-design techniques and analytical kernel selection for training large recommendation models on AMD GPUs.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on hardware-model co-design, not LLM evaluation or benchmark methodology.
Query-Efficient Rejection Sampling for Parallel Masked Diffusion
Proposes a single-increment rejection sampling algorithm to correct token correlation bias efficiently in parallel masked diffusion.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on diffusion sampling algorithms, not language model evaluation benchmarks.
SurvICL: a Foundation Model for in-context Survival Analysis
Introduces a tabular foundation model pretrained on synthetic priors to predict survival curves in-context.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Introduces a tabular survival analysis benchmark, not LLM or language model evaluation.
Explore Once, Evaluate Many: Multiple Policy Evaluation for Stochastic Linear Bandits
Introduces an algorithm to evaluate multiple target policies simultaneously in contextual linear bandits with shared sampling.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Theoretical bandit policy evaluation, not benchmarking or evaluating LLMs.
BitSparse: Compact Activation Storage for ReLU Feed-Forward Networks
Presents a GPU format that losslessly compresses sparse activations to reduce memory usage during neural network training.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on memory compression engineering, not evaluating or benchmarking LLMs.
Topology-Inspired Fine-Tuning for Wind-Field Super-Resolution
Applies topology-inspired loss functions to fine-tune super-resolution neural networks on scientific wind-field datasets.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Evaluates wind-field super-resolution topology, not language model benchmarking.
Baselines and Score Centering in Policy Gradient Estimation
Analyzes score centering and covariance estimands to maintain reward shift invariance under regularized importance sampling.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Theoretical analysis of policy gradient estimation, not LLM evaluation benchmarks.
Learning Rational Strategies for Temporal Objectives in Multi-Agent Systems
Analyzes rational strategy synthesis and equilibrium guarantees for stochastic multi-agent systems with probabilistic temporal logic objectives.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Presents theoretical RL verification rather than testing or benchmarking LLMs.
Backward Compatibility in Zero-Bit Neural Audio Watermarking
Establishes a training approach to ensure backward compatibility and prevent false positives across versions of neural audio watermarking.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Covers audio watermarking backward compatibility rather than LLM evaluation benchmarks.
Robust Reinforcement Learning for Dynamic Treatment Regimes under Model and Measurement Uncertainty
Develops a robust reinforcement learning framework for dynamic treatment policies under patient measurement and model uncertainty.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on medical RL treatment regimes, not evaluating language models.
Lean Graph Search for Formal Theorem Proving
Introduces a graph-based retrieval method that traces multi-hop library dependencies to find lemmas for formal theorem proving.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on lemma retrieval for theorem provers, not LLM evaluation benchmarks.
PathFM: Fast Generative Forecasting of Multivariate Trajectories
Uses flow matching and distillation to generate full multivariate time-series trajectory forecasts rapidly.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Evaluates time series forecasting models rather than large language models.
Learning Topology-Aware Representations for Mechanics-Relevant TPMS Metamaterials
Applies persistent homology to encode global structural connectivity into learned representations of mechanical metamaterials.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Deals with mechanical metamaterials, not LLM evaluation or benchmarks.
Purify Before You Align: Improving Representation Alignment for Diffusion Models
Introduces local appearance purification to filter alignment targets and improve representation learning during diffusion model training.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on diffusion model training alignment rather than LLM evaluation.
Pixels to Tokens: Token Space Efficient Active Learning for Low-Budget Semantic Segmentation
Selects maximally informative pixel tokens directly from vision transformers to train segmentation heads under tight annotation budgets.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Addresses active learning algorithms, not LLM evaluation or benchmarks.
Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models
Evaluates on-policy distillation versus supervised fine-tuning in vision-language models, analyzing how teacher reliability impacts student behavior.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Investigates distillation training behavior rather than LLM benchmark design.
Audio-Visual Dog Identification and Tracking in Real-World Videos
Combines visual tracking and vocal fingerprinting to identify and monitor individual dogs across real-world multi-dog video recordings.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Introduces an animal audio-visual tracking benchmark, not LLM evaluation.
Spectral-Spatial Interpretation
Introduces a Shapley-based attribution method that jointly explains spatial and spectral channel importance in multispectral imagery.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Presents an attribution interpretability technique, not LLM benchmark evaluation.
Semantic Latent Alignment for Flow Matching with Invertible Bi-Lipschitz Adapters
Proposes invertible bi-Lipschitz adapters to align pretrained latent spaces with semantic representations for flow matching without retraining encoders.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Explores latent alignment for generation, not LLM benchmark evaluation.
When Should a Low-Light Pipeline Generate? Auditable Risk Control for Selective Generative Enhancement
Presents an auditable framework that uses risk budgeting to selectively deploy generative enhancers over base restoration models in low-light images.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on image enhancement routing rather than LLM benchmarks.
L2GSSL: Label-Efficient Local-to-Global Self-Supervised Learning for Volumetric Healthcare Data
Introduces a label-efficient self-supervised learning framework that splits volumetric CT scans into local slice and global context representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Proposes self-supervised pretraining for CT scans, not LLM evaluation.
ManiFusion: Unlocking the High-Throughput Generation via Superposition in Manifold Space
Proposes a framework that increases image diffusion throughput by fusing and processing multiple generation samples simultaneously in manifold space.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on generative throughput rather than language model evaluation benchmarks.
Rethinking Classifier-Free Guidance for TI2I Flow Matching
Identifies early-stage issues with classifier-free guidance in flow matching models and proposes a correction for controllable image editing.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Studies flow matching mechanisms, not LLM benchmarks or evaluation methods.
International Multi-Centre Validation of Unsupervised Domain Adaptation for Precise Discrimination between Normal and Abnormal Retinal Development
Validates an unsupervised domain adaptation model to classify normal and abnormal retinal development across diverse optical coherence tomography systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Evaluates medical computer vision domain adaptation, not language model benchmarks.
Single-stage joint diffusion of sky images and clear-sky index for ultra-short-term irradiance forecasting: what the frame-to-irradiance stage discards
Proposes a single-stage joint diffusion method to forecast solar irradiance directly from sky images without requiring a separate regression model.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Forecasting diffusion model, not an LLM benchmark.
Temporal Periodic Image Registration with Implicit Neural Representations
The paper applies implicit neural representations with temporal consistency constraints to register periodic medical image sequences across time.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Presents an INR method, not an LLM benchmark.
Beyond the Dominant Label: Recovering Coexisting Lesion Evidence with Multiple Instance Learning
The paper introduces a multiple instance learning method to recover coexisting secondary lesions from whole-slide pathology images labeled only by dominant severity.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Develops a multiple instance learning algorithm, not an LLM benchmark.
REKI: Registering Knowledge in VLAs
The paper introduces a compact vision-language-action model using register tokens as persistent memory to reduce control oscillations in robotics.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Introduces a robotic policy architecture, not an LLM benchmark.
FutureLift: Lifting Trajectory Proposals into Bidirectional Future Graphs for Motion Forecasting
The paper presents a refiner that models motion proposals as heterogeneous temporal graphs to improve trajectory forecasting for autonomous vehicles.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Focuses on trajectory prediction models, not LLM evaluation frameworks.
How Much Physics Can Vision Learn from Audio? Probing and Distilling Damping Structure
The paper investigates learning physical damping properties from impact audio and distills this knowledge into vision models.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:18
Not relevant
Probes physical representations across audio-vision, not general LLM benchmarking.
Privacy-Preserving Text Inference for Health-Misinformation Classification and Semantic Retrieval
Designs a homomorphic encryption framework for privacy-preserving text classification and semantic retrieval on health misinformation queries.
Preprint
LLM evaluation and benchmarks
via arxiv · 17 Oct, 06:17
Not relevant
Focuses on homomorphic encryption text inference rather than LLM benchmarking methods.
721–780 of 3,345← PreviousNext →