Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · Small and efficient models — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions
The authors develop a clinical benchmark evaluating language model pipelines for generating multidisciplinary second opinions on complex medical cases.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not target model distillation, quantization, or inference acceleration.
Knowledge That Is Linear Before Fine-Tuning Generalizes After It
The authors study why certain linearly represented facts in language models support generalization to new relations after fine-tuning while other recalled facts do not.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Examines representation dynamics without addressing model efficiency or compression.
Learning to Steer LLM Agents and Multi-Agent Systems
The authors propose a learned steering agent that monitors execution context and intervenes to prevent goal drift in tool-using language model systems.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not explore model compression, quantization, or efficient serving.
Learning Self-Orchestration in Decentralized Agent Swarms
The authors present a market-based post-training framework that allows decentralized agent swarms to learn both action policies and coordination mechanisms without central orchestration.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not study model compression, pruning, or efficient inference methods.
Twice Upon a Time: Complementary Representations for Time-Series Reasoning
The authors propose combining line plots and normalized delay embeddings to provide complementary visual representations for time-series reasoning in language models.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not investigate model quantization, pruning, or serving efficiency.
Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
The authors evaluate how language models alter their refusal behavior when informed they are being monitored in English and five Indic languages.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not cover model compression, pruning, or efficient inference architectures.
GeoState: Learning View-Decoupled Geometry States for 3D World Modeling
The authors introduce GeoState, a view-decoupled 3D world modeling approach separating scene dynamics from camera motion.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not investigate model quantization, pruning, or efficient inference.
MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering
The authors propose a post-training method enabling autonomous language model agents to organize experiments and carry out machine learning engineering tasks.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Trains a 35B model for task automation rather than focusing on compression or efficient serving.
FDE-Gym: The Last Mile of AI Delivery
The authors introduce FDE-Gym, a benchmark of 95 customer delivery tasks evaluating AI agents on ambiguous requirements and live software environments.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not explore model compression, quantization, or efficient inference methods.
LIBERO-PeRM: Benchmarking Personalized Robotic Manipulation
The authors introduce LIBERO-PeRM, a simulation benchmark for studying how embodied robotic agents learn and follow user preferences in manipulation tasks.
Preprint
Small and efficient models
via arxiv · 17 Oct, 06:17
Not relevant
Does not investigate model compression, distillation, quantization, or efficient serving.
Reliability without Validity: A Systematic, Large-Scale Evaluation of LLM-as-a-Judge Models Across Agreement, Consistency, and Bias
The paper evaluates twenty-one language models used as judges across three benchmarks, finding widespread discrepancies between agreement metrics and underlying validity.
PreprintOlder paper (2026)
Older paper (2026) — discussed this week
Small and efficient models
via blog · 16 Oct, 06:19
Not relevant
Focuses on evaluation methodology rather than model efficiency or compression.
CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
The authors introduce CharXiv, a benchmark of realistic scientific charts designed to test descriptive and reasoning capabilities in multimodal language models.
PreprintOlder paper (2024)
Older paper (2024) — discussed this week
Small and efficient models
via blog · 15 Oct, 15:11
Not relevant
Benchmark study on multimodal reasoning, not model efficiency or compression.
TorchSpin: Differentiable Electron Paramagnetic Resonance Simulation in PyTorch
The paper presents an open-source PyTorch library providing differentiable forward simulation of electron paramagnetic resonance spectra for machine-learning workflows.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:07
Not relevant
Focuses on magnetic resonance simulation, not model compression.
Delay Complexity Dimension: Learning with Delayed and Censored Labels
The paper introduces a sample complexity metric to analyze binary classification learning under randomly delayed and censored labels.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical paper on delayed labels, not small model efficiency.
Wong--Zakai Convergence and FNO Learning for Stochastic Volterra Equations
The paper proves Wong-Zakai convergence and applies Fourier neural operators to learn solution operators for stochastic Volterra integral equations.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Studies neural operators for integral equations, not model compression.
Semi-Amortized Bayesian Inference with Reusable Local Posteriors
The paper proposes a semi-amortized Bayesian inference method that trains neural estimators for parameter blocks and alternates with Markov chain updates.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with amortized Bayesian computation, not small language models.
Virtual-Alloy Physics-Aware Semantic System for extrapolative prediction of perovskite solar cells
The paper introduces a physics-aware machine learning framework that interpolates crystal graphs to predict performance in perovskite solar cells.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with materials science machine learning, not small models.
PMO-Dock: Benchmarking Docking, Specificity, and Generalization in Molecular Optimization
The paper introduces a standardized 25-task benchmark and evaluation protocol for docking-based molecular optimization in drug design.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on molecular docking benchmarks, not small efficient models.
Data Density Scaling Laws for Image Self-Distillation
The paper proposes a revised scaling law for image self-distillation that incorporates sample repetition alongside unique sample counts.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on visual self-distillation scaling laws, not efficient model inference.
IR-PRM+ with Previous-Utility Prediction: Constant Regret and Best-Iterate Convergence
The paper establishes constant regret and convergence guarantees for simultaneous and alternating regret matching variants using previous-utility prediction in matrix games.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Presents game-theoretic regret minimization, not efficient model deployment.
Discrete Diffusion Models are Minimax Optimal Under Sparsity
The paper establishes minimax-optimal statistical rates for discrete diffusion models generating text and categorical data under sparsity assumptions.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Covers theoretical minimax bounds, not practical model efficiency.
Optimization for One, Feasibility for Most: Decoupling Optimization from Feasibility in Chance-Constrained Programs
The paper proposes a framework that decouples candidate generation from feasibility assessment using structured sampling for chance-constrained stochastic programs.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with stochastic programming, not efficient language models.
Lag: A Mean-Field Optimal Policy for Online Assignment with Reusable Resources
The paper develops a closed-form index policy for online task assignment with reusable resources, establishing its asymptotic optimality in fluid limits.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with multi-armed bandits, not efficient language models.
What Information Buys in Active Inference
The paper compares active inference to standard exploration in reinforcement learning and proposes a square-root calibration to prevent sub-optimal actions.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Analyzes theoretical exploration bounds in RL, not small models.
Deep Generative Models for Phylogenetic Inference with Complex Evolutionary Processes
The paper studies deep generative simulation-based inference to estimate phylogenetic tree posteriors from sequences under complex evolutionary models.
Peer-reviewed
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with biological tree generative models, not model efficiency.
Conformalized Physics-Informed Weak Regression for Parameter Estimation in Epidemic Models
The paper presents a weak regression approach combined with conformal prediction to estimate parameters and uncertainty in epidemic models without numerical derivatives.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on physics-informed epidemic regression, not model compression.
Theoretical and Practical Advances in Hierarchical Bayesian Deep Learning Methodology
The paper introduces a multilevel particle marginal Metropolis-Hastings method for joint Bayesian inference of neural network parameters and prior hyperparameters.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Presents hierarchical Bayesian MCMC theory, not efficient language models.
Backpropagating Verifier Rewards Through Continuous Flow Language Models
The paper introduces a post-training framework using intermediate token critics to backpropagate verifier rewards through continuous flow language models.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with RL training for continuous flow models, not efficiency.
Contextual Credit Policy Optimization
The paper presents a method that weights trajectory peers by context similarity to improve step-level credit assignment for language model agents.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on RL credit assignment algorithms, not model compression.
Neural Supervised Clustering for Learning Individualized Treatment Rules with Many Treatments
The paper introduces a neural Q-learning framework that clusters treatments by response similarity to improve individualized treatment rules across many options.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with individualized treatment rules, not efficient language models.
TRACER: Trace-Regularized Training Against Indirect Prompt Injection
The paper introduces an adversarial training framework that hardens models against indirect prompt injection across retrieval and tool interaction channels.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with adversarial training against attacks, not model efficiency.
Student Copula Markov Networks
The paper extends undirected graphical models to non-Gaussian data using copula densities and provides an estimation algorithm.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Deals with statistical copula networks, not small language models.
Towards Training and Inference of Graph Neural Networks in Graph Databases
The paper shows how graph databases can execute graph neural network sampling, retrieval, and inference directly without separate in-memory pipelines.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Studies GNNs in graph databases, not small language models.
Learning in Strategic Queuing with Geometric Recharge: From Bandits to Systems
The paper analyzes packet routing throughput when selfish queue agents use no-regret learning algorithms to select buffered servers.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on packet routing queues, not efficient model inference.
Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent
The paper proposes a Bayesian full waveform inversion framework that uses learned diffusion models as regularizers for geological reconstruction.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on geophysical inverse modeling, not small model efficiency.
Adaptive Computation with Conformal Certification
The paper develops an adaptive computation framework offering conformal uncertainty guarantees for processing large scientific and medical imagery efficiently.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on scientific imaging compute adaptation, not small language models.
FireGraphNet: Sub-daily wildfire spread prediction with directed graph neural networks
The paper proposes a directed graph neural network approach to forecast twelve-hour wildfire spread using spatial and environmental attributes.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on geospatial graph models rather than model compression.
From Detection To Anticipation: Continuous Onset Forecasting For Stuttered Speech
The paper develops a continuous forecasting method using speech representations to anticipate stuttering events shortly before they occur.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on speech onset forecasting rather than LLM efficiency.
LLMs program using Reusable and Composable Abstract Representations
The paper demonstrates that language models use modular abstract representations to generalize code generation across different programming languages and strategies.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Studies activation geometry in code LLMs, not model compression.
FinGREAT: Evaluating LLMs on Financial Graph-guided Retrieval And Typing
The paper benchmarks language models on extracting and categorizing double-entry accounting relationships from corporate financial disclosure filings.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Introduces a financial benchmark rather than model compression techniques.
Multi-Sensitive Distributional Fairness: Joint Wasserstein Audits and Shapley Allocation
The paper presents a framework using Wasserstein geometry and Shapley values to audit and decompose intersectional fairness disparities across multiple attributes.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Theoretical fairness decomposition, unrelated to efficient model inference.
Beyond Time Induction: Structured Conditional Neural Solvers for Parametric Stochastic-Volatility Pricing
The paper introduces a neural solver architecture to accurately compute solutions and sensitivities for parametric stochastic volatility partial differential equations.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on neural PDE solvers rather than LLM efficiency.
Exact Scaling Laws for a Random-Features Bigram Model
The paper derives theoretical scaling laws for prediction regret in a capacity-constrained bigram model with power-law token frequencies.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Analyzes bigram capacity limits rather than small model efficiency techniques.
Verifier-Grounded Agentic RL for Provably Correct Code
The paper introduces an agentic reinforcement learning approach that uses formal program verifier diagnostics as intermediate rewards to produce verified code.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Does not address model compression, pruning, or efficient inference.
Historical-Feature Residual Adaptation for Sequential Screening
The paper proposes an acquisition-time residual adaptation method that uses historical features to improve hit rates in sequential screening.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Does not investigate model compression or efficient model serving.
Why don't Graph Transformers attend to the same token?
The paper examines why molecular graph transformers avoid attention sink patterns seen in language models and highlights attention design impacts.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Studies attention sink mechanisms rather than model compression or efficiency.
BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments
The paper introduces a framework to translate and decompose clinical measurement records across heterogeneous assessment systems within predefined error tolerances.
Peer-reviewed
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Does not focus on model compression or efficient inference.
Dynamic Graph World Modelling: Learning Future Dynamics from Temporal Context
The paper presents a dynamic graph framework to jointly forecast evolving node and relation representations from historical graph contexts.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Focuses on graph modeling rather than small efficient architectures.
One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models
The paper shows that one-step prediction accuracy in joint-embedding world models is an unreliable indicator of downstream planning performance.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Studies prediction fidelity vs planning metrics, not model efficiency.
RA$^2$: Retain-Anchored Attraction Preserves Forget-Adjacent Utility in LLM Unlearning
The paper proposes a latent-space unlearning method that preserves model performance on benign tasks conceptually adjacent to forgotten domains.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Does not address model efficiency, compression, or fast inference.
Fully sequential Gaussian process regression for preference learning
The paper presents a sequential Gaussian process method and sampling policy for continuous optimization based on pairwise preference comparisons.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Bayesian optimization theory, not model compression or efficient LLM inference.
Selective Next-Location Prediction with MetaModelSelect: A Lightweight Post-Hoc Confidence Metamodel
The paper applies a lightweight post-hoc classifier to evaluate confidence and filter out incorrect next-location predictions from recurrent models.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Specific cellular location predictor, not small language models or inference acceleration.
ActMOF: Mapping Reticular Synthesis through Active Learning
The paper introduces an experimental benchmark to evaluate active learning and Bayesian optimization strategies for synthesizing metal-organic frameworks.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Active learning for chemistry experiments, not model compression or SLMs.
W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition
The paper introduces a self-supervised wavelet predictive architecture to extract multiscale motion features from wearable activity sensors.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Sensor signal representation learning, not small language models or inference efficiency.
Comprehensive Comparisons of Reinforcement Learning Algorithms in Autonomous Driving
The paper benchmarks four reinforcement learning algorithms on safety, data efficiency, and stability for autonomous vehicle intersection navigation.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Autonomous driving control comparison, not small language models or compression.
Large-Step Last-Iterate Convergence of Random-Reshuffling Stochastic Gradient Descent
The paper establishes theoretical last-iterate convergence rates for random-reshuffling stochastic gradient descent using larger stepsizes.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
General convex optimization convergence analysis, not model compression or efficient serving.
State-Matched Sequence Conformal Prediction
The paper proposes a sequential conformal prediction algorithm that groups calibration scores by state similarity rather than pure temporal recency.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Does not study small language models or inference optimization.
Digital Self-Interference Cancellation for In-Band Full-Duplex Systems Based on Transformer Neural Operators
The paper applies transformer neural operators to model interference channels and cancel digital self-interference in full-duplex radio systems.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Neural operator for full-duplex radio, not general model compression.
SKG: A Law-Induced Engine from Inference to Induction
The paper presents a mathematical framework unifying symplectic geometry, kernel methods, and physical conservation laws for physics-constrained learning.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Geometric mechanical inference framework, not small language models or distillation.
CktHGVAE: A Symmetric Design/State Heterogeneous Graph Variational Autoencoder for Transistor-level Analog/Mixed-signal Circuit Design and Analysis
The paper introduces a heterogeneous graph variational autoencoder to model design and state variables jointly for analog circuit analysis.
Preprint
Small and efficient models
via arxiv · 15 Oct, 15:06
Not relevant
Circuit design optimization, not small or efficient language models.
781–840 of 2,430← PreviousNext →