Every paper checked — nothing hidden

All papers

Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.

PaperTopicRelevanceFeedback
OA-MAP: Evidence-Grounded Multi-Agent Multimodal Framework for Interpretable Knee Osteoarthritis Progression
Introduces an evidence-grounded multi-agent framework combining multimodal medical data and clinical literature for knee osteoarthritis progression prediction.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Applies multimodal agents to medical prediction rather than proposing LLM evaluation benchmarks.
Q-Shaped Options for Hierarchical Reinforcement Learning
Develops an abstraction approach for hierarchical reinforcement learning to balance temporal option boundaries with state-dependent value representation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops a reinforcement learning algorithm rather than an LLM evaluation methodology.
Instruction-Conditioned Electromagnetic Spectrum Understanding via Budget-Adaptive Signal Tokenization
Introduces a budget-adaptive tokenization framework that balances token allocation with input length for raw RF signal understanding.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on multimodal signal modeling rather than LLM evaluation methodology or benchmark contamination.
Scalable Hierarchical Graph Generation via Soft Community Structure
Presents a three-stage hierarchical generation method for large attributed graphs using recursive soft community decomposition.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on attributed graph generative modeling rather than LLM evaluation or benchmark reliability.
Learning to Plan by Looking Back: Hindsight Hierarchies for Training Reasoning Models
Proposes a training framework that teaches reasoning models to plan by reverse-engineering solution ideas from hindsight examples.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a training loop methodology rather than an LLM evaluation benchmark or framework.
Unifying Policy Learning and State Prediction through Spatial Language Modeling
Unifies robotic policy learning and future state prediction using an autoregressive Transformer trained on spatial sequence tokens.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Does not address general LLM benchmarks or evaluation frameworks.
Recursive Self-Improvement through Multi-Agent Self-Supervision
Presents a multi-agent self-supervision method that uses evolutionary workflow optimization and fine-tuning for recursive model self-improvement.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on recursive self-improvement training rather than establishing a general evaluation benchmark.
AI-Based On-Board Maritime Object Detection for Earth Observation Payload Data Reduction on Versal Embedded Hardware
Deploys a quantized YOLOX-S detector on embedded hardware for onboard maritime satellite imagery selection and data reduction.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Does not introduce general LLM evaluation benchmarks or methodologies.
When Has a Bayesian Neural Network Sampled Enough? Adaptive Inference Time with Statistical Guarantees
Applies confidence sequences to Bayesian neural networks to dynamically allocate Monte Carlo samples per input with statistical guarantees.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops adaptive stopping criteria for sampling, not an LLM benchmark.
Equal-Budget Monte Carlo Tree Search versus Randomized-Restart List Scheduling for DAG Workflows: A Controlled Equal-Budget Computational Study
Reports an equal-budget study finding randomized-restart list scheduling outperforms Monte Carlo Tree Search on DAG workflow scheduling.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Compares scheduling search algorithms, not language model evaluation.
VibeEdit: Image Editing with Canvas Instructions
Presents VibeEdit, an image editor conditioned on spatial canvas annotations to perform targeted object additions, modifications, or removals.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Constructs a benchmark solely for image editing instruction adherence, not LLM evaluation.
From Prompting to Composing: A Spatial Canvas Interface for Poster Generation
Introduces Compo and a spatial canvas interface enabling users or agents to guide poster layout and image generation.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates a specific graphic layout interface rather than LLM benchmarks.
La-Ribo: RNA Co-Design via Geometry-Latent Flow Matching
Proposes La-Ribo, a geometry-latent flow matching framework designed for simultaneous RNA nucleotide sequence and 3D structure co-design.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates biological design capabilities, not LLM benchmarks or evaluation.
AdaCast: Conditional Parameter Generation for Adaptive Time Series Forecasting
Presents AdaCast, a parameter generation method producing input-specific low-rank updates for foundation models in time-series forecasting.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on adaptive time series forecasting rather than LLM evaluation.
Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs
Introduces Cluster-TNN, a mini-batch graph partitioning framework that enables scalable topological deep learning on large graphs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on graph neural network mini-batching, not LLM evaluation.
Real-Time Motion Planning with Dynamic Hazards: Classical vs. Learning-Based Methods
Benchmarks classical planning against learning-based methods in real-time motion planning under deterministic and stochastic rotating hazard fields.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Benchmarks motion planning algorithms, not language model capabilities.
How Much Audio Is Left In An Embedding? An Inversion Audit Of Audio Encoders
Audits audio encoders by reconstructing music using a latent diffusion model to quantify signal properties preserved across training objectives.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Audits audio representation retention via latent diffusion, not LLM evaluation.
Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings
Proposes Syn-Omni, a framework combining modality-expert LoRA paths and progressive routing to balance shared and modality-specific omnimodal embeddings.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a model architecture evaluated across tasks, not an LLM benchmark study.
DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception
Introduces Dynamic Vector Decoding to efficiently map 2D and 3D perception coordinates into compact discrete tokens for multimodal LLMs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on perceptual decoding architecture, not language model evaluation.
Unlocking the Regulatory Genome by ARGUS: An Evidence-Constrained Agentic Framework for Interpreting Single Nucleotide Variants
Proposes ARGUS, an agentic framework separating deterministic genomic models from LLM reasoning to interpret noncoding single nucleotide variants reliably.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on genomic interpretation framework rather than general LLM evaluation benchmarks.
Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery
Surveys recent developments in physics-integrated machine learning applications across high-energy nuclear physics experiments and simulations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Physics domain review, not an LLM benchmark or evaluation study.
Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction
Presents ME-World, an egocentric world model generating synchronized multi-agent first-person video streams with fine-grained physical interactions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces consistency metrics specifically for its own generative world model, not general LLM benchmarking.
Learning Probabilistic Logic Programs with Functional Gradient Guided Language Models
Introduces grasp, a framework combining functional gradient boosting with LLM proposal generation to learn probabilistic logic programs from relational data.
Peer-reviewed
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a neurosymbolic method for logic programs rather than an LLM evaluation framework.
A Structural Theory of Cognitive Representation and Problem Solving,Contexts, Invariance, and the Knowledge Space
Proposes a formal structural framework defining context formation, abstraction, and invariance operations for cognitive representation and problem solving.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes theoretical cognitive representations without evaluating or benchmarking LLMs.
Prior or Feedback? What an LLM Uses When Adapting Neural Operators
Investigates whether LLM scientific agents rely on task priors or experimental feedback when configuring neural operator adaptations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an experimental analysis of agent decision drivers rather than an LLM benchmark.
Prediction-Powered Data Fusion for Treatment Effect Estimation
Develops a framework fusing small randomized controlled trials with large observational data to improve treatment effect estimation precision without bias.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on causal inference estimators rather than LLM benchmarks or evaluation methods.
RiCo: Neural Simulation of Rigid-Body Interactions via Local Contact Reasoning
Presents RiCo, a neural physics simulation method that models rigid-body interactions via sparse local contact surface reasoning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a physics simulation method, not an LLM benchmark.
ContiLNN: Mitigating Slice Sampling Discontinuity with Liquid Neural Networks for Medical Image Restoration
Proposes ContiLNN, which uses closed-form continuous-time modules to improve cross-slice continuity and restoration in 2D medical imaging.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an image restoration network architecture, not an evaluation benchmark.
Overcoming Prior Barriers: Supervised Fine-Tuning under Long-Tail Distribution
Analyzes long-tail concept learning during supervised fine-tuning using a theoretical prior barrier metric to guide data needs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces an instruction selection technique rather than an LLM evaluation benchmark.
Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Models
Distills geometric privilege into vision-language models during training to improve spatial reasoning without inference overhead.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a distillation training method rather than an evaluation benchmark.
HANS: A Handwritten Answer Sheet Dataset for Noisy Hybrid Document Parsing
Introduces an annotated dataset of handwritten student answer sheets with complex formulas, text, tables, and noise artifacts.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a document dataset for OCR rather than an LLM capability evaluation benchmark.
OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport
Proposes a streaming optimal transport method to monitor LLM agent trajectories in real time against reference runs.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes an online monitoring mechanism rather than an evaluation benchmark.
ARC: A Reasoning Recipe for Robot Foundation Models
Presents a method to improve zero-shot robot foundation model performance using causal reasoning traces generated from demonstrations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a training and prompting recipe for robot models, not an evaluation benchmark.
GeoReform: Reflective Formalization Evolution for Multimodal Geometry Problem Solving
Proposes an evolutionary framework that optimizes geometric diagram formalizations to improve multimodal geometry problem solving.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a formalization framework to improve reasoning, not a new benchmark or evaluation methodology.
HRIL: Learning Multimodal Synergy via Higher-Order Tensor Modeling
Proposes a higher-order tensor modeling framework to preserve synergistic cross-modal interactions in self-supervised multimodal representations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a representation learning method rather than an evaluation benchmark.
SpaceFlow: Locally Controllable 3D Generation
Introduces a training-free 3D generation pipeline enabling local geometric and appearance control using 3D primitives.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a 3D generation technique rather than an evaluation benchmark.
LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC
Presents a bidirectional JEPA world action model with diffusion-steering model predictive control for robot state tracking and planning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops a predictive model architecture and control framework, not an evaluation benchmark.
MAMHOI: Factorizing Scene-Aware Human-Object Interaction through Affordances
Factorizes scene-aware human-object interaction generation into motion-affordance prediction and affordance-conditioned motion synthesis.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a generative synthesis model rather than an LLM evaluation benchmark.
RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments
Presents a top-down skill refinement system for robot self-improvement through structured execution feedback and reusable modular skills.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Proposes a system framework for self-evolution, not an LLM evaluation benchmark or assessment methodology.
Ecology of AI Agents: Collaboration Creates a Population Threshold for Takeoff
Formulates a population dynamics model to study takeoff thresholds and self-replication risks in collaborative AI agents.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a theoretical dynamics model, not an empirical evaluation benchmark.
Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception
Develops multi-layer linear probes on model activations to detect agent deception and sabotage across diverse scenarios.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a probe-based detection method rather than a general LLM evaluation benchmark.
Bi-FORK: Generative Modeling of High-Dimensional Bifurcating Systems
Proposes a generative flow matching method with repulsion-guided sampling to model one-to-many bifurcation trajectories in physical systems.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a scientific generative framework rather than an LLM evaluation benchmark.
From Reactive Containment to Proactive Assurance: Lessons from OpenAI, Anthropic, and Google Agent Security Incidents
Analyzes security incidents from frontier AI agent evaluations and proposes a framework for proactive boundary assurance.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a case study and security framework, not a new evaluation benchmark.
AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits
Introduces a generative model that allows flexible post-hoc text editing through learned insertion, substitution, and deletion operations.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a generative modeling technique rather than an evaluation framework.
Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
Proposes a multi-agent framework that evolves the data generation space using learner feedback to synthesize agent training trajectories.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a data synthesis framework for training agents, not an evaluation benchmark.
Beyond Binary Verifiable Rewards: Behavioral Self-Rewarding for SWE Agents
Introduces behavioral self-rewarding to refine reinforcement learning feedback for software engineering agents by comparing execution trajectories.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Uses SWE-bench to train and evaluate agents rather than proposing a new benchmark methodology.
Self-Preservation in Language Models
Investigates self-preservation in language models by using task banks to steer synthetic replay during continual instruction tuning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on continual learning methods rather than an LLM evaluation benchmark or judge system.
Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data
Proposes a mesh-native tokenization approach to adapt foundation model architectures to unstructured scientific simulation data.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an architecture for physics data, not an LLM benchmark or evaluation methodology.
Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building
Benchmarks machine learning and pretrained foundation models for day-ahead electricity forecasting in a university building.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
An applied forecasting case study, not a benchmark or evaluation method for LLMs.
Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller
Demonstrates a backdoor attack where malicious reasoning degradation is triggered incrementally using invisible prompt tokens and stage tracking.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on introducing and demonstrating an attack mechanism, not an evaluation benchmark.
CLEAT: Learning Value-Guided Clarification for Interactive Agents
Co-trains an interactive agent's task policy with a clarification-value controller to optimize when to ask follow-up questions.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Develops a co-training framework for interactive agents rather than an evaluation benchmark.
Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization
Introduces a key-value cache compression method representing attention activations as sums of compact Kronecker products.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an attention architecture, not an evaluation framework or benchmark.
MagicBeanStalk: Escaping the RLVR Zero Advantage Trap with Recursive Data Synthesis
Analyzes zero-advantage training plateaus in reinforcement learning with verifiable rewards and proposes recursive data synthesis to address them.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Analyzes RLVR training data synthesis rather than proposing a general LLM evaluation benchmark.
Incremental Retrieval-Augmented Generation for Human-in-the-Loop Decision Support
Evaluates an incremental retrieval-augmented generation framework that progressively populates its knowledge base from human decision precedents.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents an incremental RAG system rather than a new evaluation framework or benchmark.
Recurrent Harness for Agentic Continual Learning
Proposes a recurrent harness framework that uses streaming feedback to revise textual memory for continual agent learning.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Evaluates on existing benchmarks rather than proposing a new evaluation methodology or benchmark.
Unsupervised Multimodal Reward Modeling
Trains an unsupervised vision-language reward model using intermediate layer representations and caption perturbations without human preference labels.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a training method for reward models rather than an LLM evaluation benchmark.
KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting
Develops a temporal encoder injecting engineering domain priors to forecast rare, high-cost events in multivariate time series.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Focuses on multivariate time-series forecasting models rather than LLM evaluation.
Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data
Constructs a multimodal simulator dataset and trajectory prediction model for autonomous driving in urban roadway work zones.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Introduces a driving trajectory dataset, not an LLM evaluation benchmark.
Faithful and Complete LLM-Assisted Automated Construction of Hierarchical Hardware Knowledge Graphs
Introduces an automated pipeline using language models to construct hierarchical knowledge graphs from complex hardware datasheets.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Presents a knowledge graph construction pipeline rather than an LLM benchmark.
Semantic Views: Certified Reuse of LLM Labels Across Semantic Queries
Presents a certified semantic filtering technique that reuses prior model labels to reduce language model calls in database queries.
Preprint
LLM evaluation and benchmarks
via arxiv · 12 Oct, 16:28
Not relevant
Addresses certified query processing in databases rather than LLM benchmarking or evaluation.
3,181–3,240 of 3,345← PreviousNext →