Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · Small and efficient models — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
PDE-PFN: Prior-Data Fitted Neural PDE Solver
Proposes a transformer solver that uses in-context learning trained on approximate solutions to predict partial differential equation fields.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on physics-informed in-context learning solvers, not small language model compression or efficiency.
AgentTune: A Unified Training Lifecycle for Tool-Using LLM Agents
Presents an open-source library that unifies training, evaluation, reinforcement learning, and distillation workflows for tool-using language model agents.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on agent runtime, training, and workflows rather than small efficient model architectures.
Hidden Data Challenges in Clinical Machine Learning
Identifies and evaluates temporal, semantic, and population preprocessing misalignments that cause data leakage and bias in clinical machine learning pipelines.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Studies clinical electronic health record preprocessing, not efficient models or inference techniques.
EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning
Proposes a reinforcement learning framework with verifiable rewards and error grounding to align multimodal emotion descriptions with human preferences.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on reinforcement learning for emotion preference alignment, not small efficient models.
Opening the Black Box of Classifier-Free Guidance via Information Bottleneck
Analyzes classifier-free guidance in diffusion models through an information bottleneck framework to characterize when conditioning information is most effective.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Studies diffusion sampling guidance schedules, not model compression, quantization, or small language models.
BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning
Introduces a conjugate gradient solver for large-scale kernel ridge regression using sketched block preconditioning to improve memory efficiency and convergence.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Scales kernel ridge regression solvers, not deep model compression, quantization, or efficient LLM inference.
PlacePulse: Learning Transferable Place Representations from Structural Geographic Data
Presents a geospatial foundation model that creates structural place embeddings from sociodemographic and business data across hexagonal spatial units.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Geospatial embedding representation model, not small language model distillation, quantization, or efficient serving.
Model-free Bayesian Clustering and Multimodal Posterior Summarisation
Develops a model-free Bayesian clustering method using martingale posteriors and Wasserstein summarization to bypass explicit likelihoods and MCMC sampling.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Addresses Bayesian clustering posterior computation, not model compression or efficient LLM deployment.
Why Linear Models Can Still Work in a Complex and Changing World
Analyzes theoretically and empirically why linear models often out-predict complex nonlinear models under finite samples and environment distribution shifts.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Analyzes linear versus nonlinear model generalization, not small language model compression or efficient serving.
Desertification Forecasting in Semi-Arid Regions: Using Deep Learning to Probe the Observability Limits of Land Degradation Dynamics
Uses a convolutional LSTM on satellite data to evaluate the predictability and observational limits of year-to-year land degradation dynamics.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Application of ConvLSTM to Earth observation data, not model compression or efficient serving.
Accelerating Linear Bandits with Persistent Candidate Sets
Introduces an efficient linear bandit algorithm that maintains a small candidate set of actions to reduce per-round evaluation costs.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on linear multi-armed bandit optimization, not small language models or deep model efficiency.
One Thing Leads to Another: The Essentials of Time Series Causal Discovery
Provides a comprehensive tutorial on time series causal discovery methods, covering underlying principles, evaluation techniques, and practical applications.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Overview of time-series causality principles, not model compression or efficient LLM inference.
PPG-Bench: A Unified Benchmark for PPG Foundation Models
Introduces a unified benchmark evaluating five public photoplethysmography foundation models across nine datasets and 26 clinical and wearable tasks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on benchmarking photoplethysmography foundation models, not small efficient model techniques.
Learning by Compression: Risk Estimates Attain the Law-of-Large-Numbers Rate
Proves that risk estimates derived from preferent compression schemes achieve standard law-of-large-numbers rates without excess logarithmic factors.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical sample-compression risk bounds, not practical model compression, quantization, or efficient inference.
Harmonic analysis and circuit approximation of Sobolev functions on quantum input spaces
Derives theoretical approximation rates for Sobolev functions on quantum state and gate spaces using harmonic analysis and finite-depth quantum circuits.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical quantum circuit approximation rates, not classical small language models or efficient inference.
A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition
Introduces a learned primal-dual solver for nonlinear model predictive control that uses temporal decomposition to scale independently of the prediction horizon.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Concerns optimal control solver architectures, not efficient small language models or LLM inference serving.
FedPCD: Priority-Constrained Federated Aggregation
Proposes a federated optimization framework that preserves global aggregate objectives while applying minimal corrections to meet individual client performance constraints.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Covers federated learning optimization across clients, not model compression, quantization, or efficient serving.
Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers
Analyzes the discrete-time dynamical system of transformer self-attention, classifying its equilibria and showing consensus alignment with the value matrix's principal eigenvector.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Investigates theoretical equilibria of attention dynamics, not efficient inference or compact model architectures.
Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models
Simulates transformer training loss spikes using quadratic models with heavy-tailed inputs and derives an adaptive optimizer hyperparameter schedule to prevent them.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on training stability dynamics, not model compression, distillation, quantization, or efficient inference.
Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data
Evaluates Transformer models trained with quantile loss on historical vessel position data to produce probabilistic ship trajectory forecasts.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on trajectory prediction models, not efficient model compression or serving.
Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment
Presents an online randomized TCP acknowledgment algorithm that provides simultaneous competitive ratio bounds and sublinear regret against the best expert.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Addresses theoretical online algorithms for TCP, not small or efficient models.
$L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression
Applies Monte Carlo Tree Search with generalized rollout policy adaptation to optimize out-of-sample feature selection for high-dimensional financial regression.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on sparse regression feature selection, not efficient model compression or serving.
Probabilistic Forecasting of Electric Vehicle Charging in a Time-varying Hierarchical Infrastructure
Combines hierarchical forecasting with conformal prediction under missing data to forecast electric vehicle charging demand with valid prediction intervals across evolving networks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on time-series conformal forecasting, not small models or efficient inference.
Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
Investigates theoretical lower bounds for randomized linear minimization oracle optimization algorithms over strongly convex sets.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on mathematical optimization lower bounds, not small models or efficient inference.
EchoTab: Learning Measurement-Grounded Representations for Echocardiographic Diagnosis through Tabular Reconstruction
Proposes a measurement-grounded representation framework using tabular tokens to link multi-view echocardiograms to clinical diagnostic tasks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on echocardiographic representation learning, not efficient model inference or compression.
A small cognitive core explains human behavior at scale
Presents a cognitive architecture based on episodic memory hierarchies and context-dependent error updates to predict human choice behavior.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Presents a cognitive architecture, not methods for compressing or serving efficient models.
CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope
Proposes an unconstrained parameterization and equivariant flow matching model for generating valid correlation matrices.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Deals with geometry of correlation matrix generation, not small or efficient models.
Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
Presents a cycle-consistent adversarial model enabling continuous sound pressure level adjustments for speech vocal intensity conversion.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on audio GAN conversion techniques, not model compression or efficient inference.
Some remarks on the connection between generative diffusion and optimal transport
Analyzes theoretical connections between generative diffusion models, flow matching, and entropic optimal transport formulations.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Mathematical study of generative diffusion dynamics, not efficient inference or small models.
Kernel-based External Validity of Experimental Studies
Develops a kernel-based maximum mean discrepancy framework to formalize and estimate the external validity and replicability of experimental studies.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Theoretical statistics framework for experimental validity, unrelated to efficient model inference.
JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation
Introduces a replay benchmark to evaluate robot motion smoothness and controller latency in vision-language-action manipulation pipelines.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on motion smoothing in robot controllers, not model compression or efficient inference.
Private and Distributionally Robust Federated Multiclass Classification
Develops a differentially private and distributionally robust ADMM framework for multiclass classification across distributed client data.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Addresses federated optimization with differential privacy, not small language models or efficient inference.
PANDA: Prior-guided Attentional Dual-path Architecture
Presents a dual-path architecture combining normalized attention and incidence priors for hypergraph message-passing neural networks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on hypergraph attention mechanisms, not efficient language model compression or inference.
Electron-Density-Informed Molecular Property Prediction Using Surrogate Functionals
Applies a surrogate functional framework incorporating ground-state electron density to improve molecular property prediction models.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on surrogate functionals for chemistry, not model compression or efficient serving.
A Critical Look at Power Sampling when Test Time Sharpening LLMs
Examines sampling methods for test-time sharpening in language models and shows simple best-of-N approaches yield comparable gains.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Investigates power sampling versus Best-of-N, not model compression or efficient on-device serving.
TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy
Introduces a benchmark evaluating tabular foundation models across point prediction, distributional calibration, and prediction interval efficiency.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Studies tabular prediction calibration, not small or efficient language model methods.
Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields
Proposes a scalable variational inference method using sparse autoregressive structures and normalizing flows for non-Gaussian spatial field models.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Addresses spatial statistics inference algorithms, not small or efficient language models.
On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models
Compares seven calendar feature encoding techniques across four time series foundation models to evaluate impact on forecast accuracy.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on feature encoding techniques, not small or efficient model compression or serving.
VQIL: Visible Quantum Interference Learning for Perturbation Response Ranking on Graphs
Introduces a parameterized quantum-walk model optimized via backpropagation to rank network node responses to seed perturbations.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on graph perturbation ranking via quantum walk algorithms, not efficient model architectures.
Transformer-based In-Context Score Operator Learning for Diffusion Models
Proposes an in-context score operator framework allowing diffusion models to adapt to unseen target distributions without retraining.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on score operator learning for diffusion adaptation, not compression or efficient serving.
Towards Understanding the Training of GFlowNets: A Theoretical Perspective
Develops a theoretical framework linking training objective losses to sampling accuracy and finite-time convergence in Generative Flow Networks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Addresses theoretical sampling bounds of GFlowNets, not small models or efficient inference.
Machine Unlearning for Federated Socially Fair k-Means Clustering
Presents an exact machine unlearning method for federated socially fair k-means clustering using separate group-level local summaries.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on unlearning speed in federated clustering rather than lightweight LLM inference.
SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark
Introduces a multi-mode urban mobility benchmark across Seoul to evaluate origin-destination travel demand forecasting models.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on urban mobility spatio-temporal modeling, not efficient inference or model compression.
Studying the Effects of Task Diversity Using Small Mathematical Worlds
Introduces two synthetic mathematical task datasets to study how task diversity affects model learning during pretraining.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Investigates task diversity's effect on internal representations, not efficient models or compression.
How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference?
Empirically evaluates the Bayesian posterior approximation quality and amortization errors of prior-data fitted networks across synthetic prior tasks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Examines Bayesian inference error decomposition rather than model compression or efficient serving.
From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds
Introduces an information-theoretic framework using rate-distortion theory to establish computable lower bounds on feature reconstruction under DP-SGD.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Investigates privacy distortion bounds under DP-SGD, not model compression or efficient serving.
Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates
Analyzes convergence rates of a multi-objective optimization method pairing norm-constrained linear minimization oracles with entropic task-weight updates.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Concerns optimization theory rather than small language models, quantization, or inference serving.
Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with Constraints
Establishes stochastic first-order and zeroth-order algorithms achieving optimal rates for constrained nonsmooth nonconvex optimization.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on pure mathematical optimization algorithms, not model compression or efficient serving.
Randomized Momentum Transport with Cheap Predictors
Introduces randomized momentum transport to track stochastic gradients using probabilistically sampled transport corrections alongside cheap predictors.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Examines optimization theory and gradient oracle costs, not small models or inference acceleration.
Adaptive Variance Reduction without Knowing Oracle Smoothness
Proposes a two-phase variance reduction method that adapts to average, standard, and noiseless smoothness settings without predefined hyperparameter constants.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Concerns stochastic non-convex optimization convergence, not model compression or efficient serving.
Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints
Develops a sequential conditioning framework enabling Gaussian process linear partial differential equation solvers to enforce linear inequality constraints.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on probabilistic numerics for PDEs rather than model compression or efficient LLM inference.
Diversity-Aware Ensemble of Quantum-Classical Models via Combinatorial Fusion
Evaluates combinatorial fusion analysis to build diverse ensembles combining classical models and variational quantum circuits for classification tasks.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on quantum-classical ensembling rather than small language models or inference efficiency.
TabMF: Learning Dataset Representations with Tabular Foundation Models
Repurposes pretrained tabular foundation models into supervised dataset encoders using dataset-level readouts and contrastive post-training.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on tabular foundation model embeddings, not model compression or efficient inference techniques.
Shared Canonical Component Removal Beyond Expert Views
Presents Shared Canonical Component Removal to quantify predictive information retained by raw machine learning representations beyond predefined expert features.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Does not address model compression, small language models, or efficient serving.
Returning to Development States: When Full Sandbox Snapshots Help Coding Agents
Evaluates full sandbox snapshot exploration for coding agents, finding benefits primarily when recovery requires restoring runtime dependencies outside Git repositories.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Does not study model compression, distillation, quantization, or small on-device models.
Inference-Time Steering Across Scaffolds and Epitopes for Sample-Efficient De Novo Nanobody Design
Applies dynamic budget allocation algorithms at inference time to select scaffolds and epitopes during de novo nanobody generative design.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on compute steering for molecular generation, not small or efficient language models.
Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models
Derives finite-sample convergence guarantees for fully discrete conditional diffusion models with finitely many denoising steps under smooth density assumptions.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Mathematical finite-sample theory for conditional diffusion, not practical small model efficiency.
Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking
Introduces PISO, an optimization framework that combines partially available gradients with zeroth-order residual tracking to reduce variance from random probing.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Optimization theory paper, not focused on efficient language model architectures or compression.
Prediction Is Not a Sufficient Memory State
Analyzes the dimensional requirements of exact recurrent memory states for cumulative learning under convex residual loss functions.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Focuses on theoretical memory state dimension in online learning, not efficient model deployment.
Hitting-Time Bounds for Asynchronous Q-Learning
Establishes finite-time error bounds for single-trajectory asynchronous Q-learning that incorporate the hitting time of the underlying Markov decision process.
Preprint
Small and efficient models
via arxiv · 12 Oct, 16:29
Not relevant
Reinforcement learning theory, not model compression or efficient serving.
2,161–2,220 of 2,430← PreviousNext →