Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · Small and efficient models — nothing is hidden. Brief papers first.
All2,430In brief3More (on-topic)455Not relevant1,957Not assessed6Older27Could not confirm6Blogs with no paper16All blogs19
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| PDE-PFN: Prior-Data Fitted Neural PDE Solver Proposes a transformer solver that uses in-context learning trained on approximate solutions to predict partial differential equation fields. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on physics-informed in-context learning solvers, not small language model compression or efficiency. | |
| AgentTune: A Unified Training Lifecycle for Tool-Using LLM Agents Presents an open-source library that unifies training, evaluation, reinforcement learning, and distillation workflows for tool-using language model agents. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on agent runtime, training, and workflows rather than small efficient model architectures. | |
| Hidden Data Challenges in Clinical Machine Learning Identifies and evaluates temporal, semantic, and population preprocessing misalignments that cause data leakage and bias in clinical machine learning pipelines. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Studies clinical electronic health record preprocessing, not efficient models or inference techniques. | |
| EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning Proposes a reinforcement learning framework with verifiable rewards and error grounding to align multimodal emotion descriptions with human preferences. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on reinforcement learning for emotion preference alignment, not small efficient models. | |
| Opening the Black Box of Classifier-Free Guidance via Information Bottleneck Analyzes classifier-free guidance in diffusion models through an information bottleneck framework to characterize when conditioning information is most effective. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Studies diffusion sampling guidance schedules, not model compression, quantization, or small language models. | |
| BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning Introduces a conjugate gradient solver for large-scale kernel ridge regression using sketched block preconditioning to improve memory efficiency and convergence. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Scales kernel ridge regression solvers, not deep model compression, quantization, or efficient LLM inference. | |
| PlacePulse: Learning Transferable Place Representations from Structural Geographic Data Presents a geospatial foundation model that creates structural place embeddings from sociodemographic and business data across hexagonal spatial units. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Geospatial embedding representation model, not small language model distillation, quantization, or efficient serving. | |
| Model-free Bayesian Clustering and Multimodal Posterior Summarisation Develops a model-free Bayesian clustering method using martingale posteriors and Wasserstein summarization to bypass explicit likelihoods and MCMC sampling. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Addresses Bayesian clustering posterior computation, not model compression or efficient LLM deployment. | |
| Why Linear Models Can Still Work in a Complex and Changing World Analyzes theoretically and empirically why linear models often out-predict complex nonlinear models under finite samples and environment distribution shifts. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Analyzes linear versus nonlinear model generalization, not small language model compression or efficient serving. | |
| Desertification Forecasting in Semi-Arid Regions: Using Deep Learning to Probe the Observability Limits of Land Degradation Dynamics Uses a convolutional LSTM on satellite data to evaluate the predictability and observational limits of year-to-year land degradation dynamics. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Application of ConvLSTM to Earth observation data, not model compression or efficient serving. | |
| Accelerating Linear Bandits with Persistent Candidate Sets Introduces an efficient linear bandit algorithm that maintains a small candidate set of actions to reduce per-round evaluation costs. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on linear multi-armed bandit optimization, not small language models or deep model efficiency. | |
| One Thing Leads to Another: The Essentials of Time Series Causal Discovery Provides a comprehensive tutorial on time series causal discovery methods, covering underlying principles, evaluation techniques, and practical applications. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Overview of time-series causality principles, not model compression or efficient LLM inference. | |
| PPG-Bench: A Unified Benchmark for PPG Foundation Models Introduces a unified benchmark evaluating five public photoplethysmography foundation models across nine datasets and 26 clinical and wearable tasks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on benchmarking photoplethysmography foundation models, not small efficient model techniques. | |
| Learning by Compression: Risk Estimates Attain the Law-of-Large-Numbers Rate Proves that risk estimates derived from preferent compression schemes achieve standard law-of-large-numbers rates without excess logarithmic factors. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Theoretical sample-compression risk bounds, not practical model compression, quantization, or efficient inference. | |
| Harmonic analysis and circuit approximation of Sobolev functions on quantum input spaces Derives theoretical approximation rates for Sobolev functions on quantum state and gate spaces using harmonic analysis and finite-depth quantum circuits. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Theoretical quantum circuit approximation rates, not classical small language models or efficient inference. | |
| A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition Introduces a learned primal-dual solver for nonlinear model predictive control that uses temporal decomposition to scale independently of the prediction horizon. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Concerns optimal control solver architectures, not efficient small language models or LLM inference serving. | |
| FedPCD: Priority-Constrained Federated Aggregation Proposes a federated optimization framework that preserves global aggregate objectives while applying minimal corrections to meet individual client performance constraints. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Covers federated learning optimization across clients, not model compression, quantization, or efficient serving. | |
| Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers Analyzes the discrete-time dynamical system of transformer self-attention, classifying its equilibria and showing consensus alignment with the value matrix's principal eigenvector. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Investigates theoretical equilibria of attention dynamics, not efficient inference or compact model architectures. | |
| Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models Simulates transformer training loss spikes using quadratic models with heavy-tailed inputs and derives an adaptive optimizer hyperparameter schedule to prevent them. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on training stability dynamics, not model compression, distillation, quantization, or efficient inference. | |
| Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data Evaluates Transformer models trained with quantile loss on historical vessel position data to produce probabilistic ship trajectory forecasts. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on trajectory prediction models, not efficient model compression or serving. | |
| Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment Presents an online randomized TCP acknowledgment algorithm that provides simultaneous competitive ratio bounds and sublinear regret against the best expert. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Addresses theoretical online algorithms for TCP, not small or efficient models. | |
| $L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression Applies Monte Carlo Tree Search with generalized rollout policy adaptation to optimize out-of-sample feature selection for high-dimensional financial regression. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on sparse regression feature selection, not efficient model compression or serving. | |
| Probabilistic Forecasting of Electric Vehicle Charging in a Time-varying Hierarchical Infrastructure Combines hierarchical forecasting with conformal prediction under missing data to forecast electric vehicle charging demand with valid prediction intervals across evolving networks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on time-series conformal forecasting, not small models or efficient inference. | |
| Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets Investigates theoretical lower bounds for randomized linear minimization oracle optimization algorithms over strongly convex sets. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on mathematical optimization lower bounds, not small models or efficient inference. | |
| EchoTab: Learning Measurement-Grounded Representations for Echocardiographic Diagnosis through Tabular Reconstruction Proposes a measurement-grounded representation framework using tabular tokens to link multi-view echocardiograms to clinical diagnostic tasks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on echocardiographic representation learning, not efficient model inference or compression. | |
| A small cognitive core explains human behavior at scale Presents a cognitive architecture based on episodic memory hierarchies and context-dependent error updates to predict human choice behavior. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Presents a cognitive architecture, not methods for compressing or serving efficient models. | |
| CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope Proposes an unconstrained parameterization and equivariant flow matching model for generating valid correlation matrices. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Deals with geometry of correlation matrix generation, not small or efficient models. | |
| Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training Presents a cycle-consistent adversarial model enabling continuous sound pressure level adjustments for speech vocal intensity conversion. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on audio GAN conversion techniques, not model compression or efficient inference. | |
| Some remarks on the connection between generative diffusion and optimal transport Analyzes theoretical connections between generative diffusion models, flow matching, and entropic optimal transport formulations. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Mathematical study of generative diffusion dynamics, not efficient inference or small models. | |
| Kernel-based External Validity of Experimental Studies Develops a kernel-based maximum mean discrepancy framework to formalize and estimate the external validity and replicability of experimental studies. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Theoretical statistics framework for experimental validity, unrelated to efficient model inference. | |
| JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation Introduces a replay benchmark to evaluate robot motion smoothness and controller latency in vision-language-action manipulation pipelines. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on motion smoothing in robot controllers, not model compression or efficient inference. | |
| Private and Distributionally Robust Federated Multiclass Classification Develops a differentially private and distributionally robust ADMM framework for multiclass classification across distributed client data. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Addresses federated optimization with differential privacy, not small language models or efficient inference. | |
| PANDA: Prior-guided Attentional Dual-path Architecture Presents a dual-path architecture combining normalized attention and incidence priors for hypergraph message-passing neural networks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on hypergraph attention mechanisms, not efficient language model compression or inference. | |
| Electron-Density-Informed Molecular Property Prediction Using Surrogate Functionals Applies a surrogate functional framework incorporating ground-state electron density to improve molecular property prediction models. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on surrogate functionals for chemistry, not model compression or efficient serving. | |
| A Critical Look at Power Sampling when Test Time Sharpening LLMs Examines sampling methods for test-time sharpening in language models and shows simple best-of-N approaches yield comparable gains. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Investigates power sampling versus Best-of-N, not model compression or efficient on-device serving. | |
| TabReliBench: Evaluating Tabular Foundation Models Beyond Predictive Accuracy Introduces a benchmark evaluating tabular foundation models across point prediction, distributional calibration, and prediction interval efficiency. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Studies tabular prediction calibration, not small or efficient language model methods. | |
| Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields Proposes a scalable variational inference method using sparse autoregressive structures and normalizing flows for non-Gaussian spatial field models. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Addresses spatial statistics inference algorithms, not small or efficient language models. | |
| On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models Compares seven calendar feature encoding techniques across four time series foundation models to evaluate impact on forecast accuracy. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on feature encoding techniques, not small or efficient model compression or serving. | |
| VQIL: Visible Quantum Interference Learning for Perturbation Response Ranking on Graphs Introduces a parameterized quantum-walk model optimized via backpropagation to rank network node responses to seed perturbations. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on graph perturbation ranking via quantum walk algorithms, not efficient model architectures. | |
| Transformer-based In-Context Score Operator Learning for Diffusion Models Proposes an in-context score operator framework allowing diffusion models to adapt to unseen target distributions without retraining. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on score operator learning for diffusion adaptation, not compression or efficient serving. | |
| Towards Understanding the Training of GFlowNets: A Theoretical Perspective Develops a theoretical framework linking training objective losses to sampling accuracy and finite-time convergence in Generative Flow Networks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Addresses theoretical sampling bounds of GFlowNets, not small models or efficient inference. | |
| Machine Unlearning for Federated Socially Fair k-Means Clustering Presents an exact machine unlearning method for federated socially fair k-means clustering using separate group-level local summaries. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on unlearning speed in federated clustering rather than lightweight LLM inference. | |
| SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark Introduces a multi-mode urban mobility benchmark across Seoul to evaluate origin-destination travel demand forecasting models. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on urban mobility spatio-temporal modeling, not efficient inference or model compression. | |
| Studying the Effects of Task Diversity Using Small Mathematical Worlds Introduces two synthetic mathematical task datasets to study how task diversity affects model learning during pretraining. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Investigates task diversity's effect on internal representations, not efficient models or compression. | |
| How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference? Empirically evaluates the Bayesian posterior approximation quality and amortization errors of prior-data fitted networks across synthetic prior tasks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Examines Bayesian inference error decomposition rather than model compression or efficient serving. | |
| From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds Introduces an information-theoretic framework using rate-distortion theory to establish computable lower bounds on feature reconstruction under DP-SGD. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Investigates privacy distortion bounds under DP-SGD, not model compression or efficient serving. | |
| Geometry-Aware Multi-Objective Optimization: Norm-Constrained Oracles with Entropic Weight Updates Analyzes convergence rates of a multi-objective optimization method pairing norm-constrained linear minimization oracles with entropic task-weight updates. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Concerns optimization theory rather than small language models, quantization, or inference serving. | |
| Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with Constraints Establishes stochastic first-order and zeroth-order algorithms achieving optimal rates for constrained nonsmooth nonconvex optimization. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on pure mathematical optimization algorithms, not model compression or efficient serving. | |
| Randomized Momentum Transport with Cheap Predictors Introduces randomized momentum transport to track stochastic gradients using probabilistically sampled transport corrections alongside cheap predictors. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Examines optimization theory and gradient oracle costs, not small models or inference acceleration. | |
| Adaptive Variance Reduction without Knowing Oracle Smoothness Proposes a two-phase variance reduction method that adapts to average, standard, and noiseless smoothness settings without predefined hyperparameter constants. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Concerns stochastic non-convex optimization convergence, not model compression or efficient serving. | |
| Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints Develops a sequential conditioning framework enabling Gaussian process linear partial differential equation solvers to enforce linear inequality constraints. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on probabilistic numerics for PDEs rather than model compression or efficient LLM inference. | |
| Diversity-Aware Ensemble of Quantum-Classical Models via Combinatorial Fusion Evaluates combinatorial fusion analysis to build diverse ensembles combining classical models and variational quantum circuits for classification tasks. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on quantum-classical ensembling rather than small language models or inference efficiency. | |
| TabMF: Learning Dataset Representations with Tabular Foundation Models Repurposes pretrained tabular foundation models into supervised dataset encoders using dataset-level readouts and contrastive post-training. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on tabular foundation model embeddings, not model compression or efficient inference techniques. | |
| Shared Canonical Component Removal Beyond Expert Views Presents Shared Canonical Component Removal to quantify predictive information retained by raw machine learning representations beyond predefined expert features. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Does not address model compression, small language models, or efficient serving. | |
| Returning to Development States: When Full Sandbox Snapshots Help Coding Agents Evaluates full sandbox snapshot exploration for coding agents, finding benefits primarily when recovery requires restoring runtime dependencies outside Git repositories. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Does not study model compression, distillation, quantization, or small on-device models. | |
| Inference-Time Steering Across Scaffolds and Epitopes for Sample-Efficient De Novo Nanobody Design Applies dynamic budget allocation algorithms at inference time to select scaffolds and epitopes during de novo nanobody generative design. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on compute steering for molecular generation, not small or efficient language models. | |
| Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models Derives finite-sample convergence guarantees for fully discrete conditional diffusion models with finitely many denoising steps under smooth density assumptions. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Mathematical finite-sample theory for conditional diffusion, not practical small model efficiency. | |
| Partially Informed Stochastic Optimization via Zeroth-Order Residual Tracking Introduces PISO, an optimization framework that combines partially available gradients with zeroth-order residual tracking to reduce variance from random probing. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Optimization theory paper, not focused on efficient language model architectures or compression. | |
| Prediction Is Not a Sufficient Memory State Analyzes the dimensional requirements of exact recurrent memory states for cumulative learning under convex residual loss functions. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Focuses on theoretical memory state dimension in online learning, not efficient model deployment. | |
| Hitting-Time Bounds for Asynchronous Q-Learning Establishes finite-time error bounds for single-trajectory asynchronous Q-learning that incorporate the hitting time of the underlying Markov decision process. Preprint | Small and efficient models via arxiv · 12 Oct, 16:29 | Not relevant Reinforcement learning theory, not model compression or efficient serving. |
2,161–2,220 of 2,430← PreviousNext →