Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| OA-MAP: Evidence-Grounded Multi-Agent Multimodal Framework for Interpretable Knee Osteoarthritis Progression Introduces an evidence-grounded multi-agent framework combining multimodal medical data and clinical literature for knee osteoarthritis progression prediction. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Applies multimodal agents to medical prediction rather than proposing LLM evaluation benchmarks. | |
| Q-Shaped Options for Hierarchical Reinforcement Learning Develops an abstraction approach for hierarchical reinforcement learning to balance temporal option boundaries with state-dependent value representation. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops a reinforcement learning algorithm rather than an LLM evaluation methodology. | |
| Instruction-Conditioned Electromagnetic Spectrum Understanding via Budget-Adaptive Signal Tokenization Introduces a budget-adaptive tokenization framework that balances token allocation with input length for raw RF signal understanding. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on multimodal signal modeling rather than LLM evaluation methodology or benchmark contamination. | |
| Scalable Hierarchical Graph Generation via Soft Community Structure Presents a three-stage hierarchical generation method for large attributed graphs using recursive soft community decomposition. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on attributed graph generative modeling rather than LLM evaluation or benchmark reliability. | |
| Learning to Plan by Looking Back: Hindsight Hierarchies for Training Reasoning Models Proposes a training framework that teaches reasoning models to plan by reverse-engineering solution ideas from hindsight examples. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a training loop methodology rather than an LLM evaluation benchmark or framework. | |
| Unifying Policy Learning and State Prediction through Spatial Language Modeling Unifies robotic policy learning and future state prediction using an autoregressive Transformer trained on spatial sequence tokens. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Does not address general LLM benchmarks or evaluation frameworks. | |
| Recursive Self-Improvement through Multi-Agent Self-Supervision Presents a multi-agent self-supervision method that uses evolutionary workflow optimization and fine-tuning for recursive model self-improvement. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on recursive self-improvement training rather than establishing a general evaluation benchmark. | |
| AI-Based On-Board Maritime Object Detection for Earth Observation Payload Data Reduction on Versal Embedded Hardware Deploys a quantized YOLOX-S detector on embedded hardware for onboard maritime satellite imagery selection and data reduction. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Does not introduce general LLM evaluation benchmarks or methodologies. | |
| When Has a Bayesian Neural Network Sampled Enough? Adaptive Inference Time with Statistical Guarantees Applies confidence sequences to Bayesian neural networks to dynamically allocate Monte Carlo samples per input with statistical guarantees. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops adaptive stopping criteria for sampling, not an LLM benchmark. | |
| Equal-Budget Monte Carlo Tree Search versus Randomized-Restart List Scheduling for DAG Workflows: A Controlled Equal-Budget Computational Study Reports an equal-budget study finding randomized-restart list scheduling outperforms Monte Carlo Tree Search on DAG workflow scheduling. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Compares scheduling search algorithms, not language model evaluation. | |
| VibeEdit: Image Editing with Canvas Instructions Presents VibeEdit, an image editor conditioned on spatial canvas annotations to perform targeted object additions, modifications, or removals. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Constructs a benchmark solely for image editing instruction adherence, not LLM evaluation. | |
| From Prompting to Composing: A Spatial Canvas Interface for Poster Generation Introduces Compo and a spatial canvas interface enabling users or agents to guide poster layout and image generation. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates a specific graphic layout interface rather than LLM benchmarks. | |
| La-Ribo: RNA Co-Design via Geometry-Latent Flow Matching Proposes La-Ribo, a geometry-latent flow matching framework designed for simultaneous RNA nucleotide sequence and 3D structure co-design. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates biological design capabilities, not LLM benchmarks or evaluation. | |
| AdaCast: Conditional Parameter Generation for Adaptive Time Series Forecasting Presents AdaCast, a parameter generation method producing input-specific low-rank updates for foundation models in time-series forecasting. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on adaptive time series forecasting rather than LLM evaluation. | |
| Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs Introduces Cluster-TNN, a mini-batch graph partitioning framework that enables scalable topological deep learning on large graphs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on graph neural network mini-batching, not LLM evaluation. | |
| Real-Time Motion Planning with Dynamic Hazards: Classical vs. Learning-Based Methods Benchmarks classical planning against learning-based methods in real-time motion planning under deterministic and stochastic rotating hazard fields. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Benchmarks motion planning algorithms, not language model capabilities. | |
| How Much Audio Is Left In An Embedding? An Inversion Audit Of Audio Encoders Audits audio encoders by reconstructing music using a latent diffusion model to quantify signal properties preserved across training objectives. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Audits audio representation retention via latent diffusion, not LLM evaluation. | |
| Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings Proposes Syn-Omni, a framework combining modality-expert LoRA paths and progressive routing to balance shared and modality-specific omnimodal embeddings. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a model architecture evaluated across tasks, not an LLM benchmark study. | |
| DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception Introduces Dynamic Vector Decoding to efficiently map 2D and 3D perception coordinates into compact discrete tokens for multimodal LLMs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on perceptual decoding architecture, not language model evaluation. | |
| Unlocking the Regulatory Genome by ARGUS: An Evidence-Constrained Agentic Framework for Interpreting Single Nucleotide Variants Proposes ARGUS, an agentic framework separating deterministic genomic models from LLM reasoning to interpret noncoding single nucleotide variants reliably. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on genomic interpretation framework rather than general LLM evaluation benchmarks. | |
| Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery Surveys recent developments in physics-integrated machine learning applications across high-energy nuclear physics experiments and simulations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Physics domain review, not an LLM benchmark or evaluation study. | |
| Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction Presents ME-World, an egocentric world model generating synchronized multi-agent first-person video streams with fine-grained physical interactions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces consistency metrics specifically for its own generative world model, not general LLM benchmarking. | |
| Learning Probabilistic Logic Programs with Functional Gradient Guided Language Models Introduces grasp, a framework combining functional gradient boosting with LLM proposal generation to learn probabilistic logic programs from relational data. Peer-reviewed | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a neurosymbolic method for logic programs rather than an LLM evaluation framework. | |
| A Structural Theory of Cognitive Representation and Problem Solving,Contexts, Invariance, and the Knowledge Space Proposes a formal structural framework defining context formation, abstraction, and invariance operations for cognitive representation and problem solving. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes theoretical cognitive representations without evaluating or benchmarking LLMs. | |
| Prior or Feedback? What an LLM Uses When Adapting Neural Operators Investigates whether LLM scientific agents rely on task priors or experimental feedback when configuring neural operator adaptations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an experimental analysis of agent decision drivers rather than an LLM benchmark. | |
| Prediction-Powered Data Fusion for Treatment Effect Estimation Develops a framework fusing small randomized controlled trials with large observational data to improve treatment effect estimation precision without bias. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on causal inference estimators rather than LLM benchmarks or evaluation methods. | |
| RiCo: Neural Simulation of Rigid-Body Interactions via Local Contact Reasoning Presents RiCo, a neural physics simulation method that models rigid-body interactions via sparse local contact surface reasoning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a physics simulation method, not an LLM benchmark. | |
| ContiLNN: Mitigating Slice Sampling Discontinuity with Liquid Neural Networks for Medical Image Restoration Proposes ContiLNN, which uses closed-form continuous-time modules to improve cross-slice continuity and restoration in 2D medical imaging. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an image restoration network architecture, not an evaluation benchmark. | |
| Overcoming Prior Barriers: Supervised Fine-Tuning under Long-Tail Distribution Analyzes long-tail concept learning during supervised fine-tuning using a theoretical prior barrier metric to guide data needs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces an instruction selection technique rather than an LLM evaluation benchmark. | |
| Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Models Distills geometric privilege into vision-language models during training to improve spatial reasoning without inference overhead. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a distillation training method rather than an evaluation benchmark. | |
| HANS: A Handwritten Answer Sheet Dataset for Noisy Hybrid Document Parsing Introduces an annotated dataset of handwritten student answer sheets with complex formulas, text, tables, and noise artifacts. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a document dataset for OCR rather than an LLM capability evaluation benchmark. | |
| OnTrack: Real-Time Monitoring and Intervention in LLM Agent Trajectories via Streaming Structure-Aware Optimal Transport Proposes a streaming optimal transport method to monitor LLM agent trajectories in real time against reference runs. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes an online monitoring mechanism rather than an evaluation benchmark. | |
| ARC: A Reasoning Recipe for Robot Foundation Models Presents a method to improve zero-shot robot foundation model performance using causal reasoning traces generated from demonstrations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a training and prompting recipe for robot models, not an evaluation benchmark. | |
| GeoReform: Reflective Formalization Evolution for Multimodal Geometry Problem Solving Proposes an evolutionary framework that optimizes geometric diagram formalizations to improve multimodal geometry problem solving. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a formalization framework to improve reasoning, not a new benchmark or evaluation methodology. | |
| HRIL: Learning Multimodal Synergy via Higher-Order Tensor Modeling Proposes a higher-order tensor modeling framework to preserve synergistic cross-modal interactions in self-supervised multimodal representations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a representation learning method rather than an evaluation benchmark. | |
| SpaceFlow: Locally Controllable 3D Generation Introduces a training-free 3D generation pipeline enabling local geometric and appearance control using 3D primitives. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a 3D generation technique rather than an evaluation benchmark. | |
| LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC Presents a bidirectional JEPA world action model with diffusion-steering model predictive control for robot state tracking and planning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops a predictive model architecture and control framework, not an evaluation benchmark. | |
| MAMHOI: Factorizing Scene-Aware Human-Object Interaction through Affordances Factorizes scene-aware human-object interaction generation into motion-affordance prediction and affordance-conditioned motion synthesis. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a generative synthesis model rather than an LLM evaluation benchmark. | |
| RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments Presents a top-down skill refinement system for robot self-improvement through structured execution feedback and reusable modular skills. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Proposes a system framework for self-evolution, not an LLM evaluation benchmark or assessment methodology. | |
| Ecology of AI Agents: Collaboration Creates a Population Threshold for Takeoff Formulates a population dynamics model to study takeoff thresholds and self-replication risks in collaborative AI agents. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a theoretical dynamics model, not an empirical evaluation benchmark. | |
| Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception Develops multi-layer linear probes on model activations to detect agent deception and sabotage across diverse scenarios. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a probe-based detection method rather than a general LLM evaluation benchmark. | |
| Bi-FORK: Generative Modeling of High-Dimensional Bifurcating Systems Proposes a generative flow matching method with repulsion-guided sampling to model one-to-many bifurcation trajectories in physical systems. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a scientific generative framework rather than an LLM evaluation benchmark. | |
| From Reactive Containment to Proactive Assurance: Lessons from OpenAI, Anthropic, and Google Agent Security Incidents Analyzes security incidents from frontier AI agent evaluations and proposes a framework for proactive boundary assurance. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a case study and security framework, not a new evaluation benchmark. | |
| AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits Introduces a generative model that allows flexible post-hoc text editing through learned insertion, substitution, and deletion operations. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a generative modeling technique rather than an evaluation framework. | |
| Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning Proposes a multi-agent framework that evolves the data generation space using learner feedback to synthesize agent training trajectories. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a data synthesis framework for training agents, not an evaluation benchmark. | |
| Beyond Binary Verifiable Rewards: Behavioral Self-Rewarding for SWE Agents Introduces behavioral self-rewarding to refine reinforcement learning feedback for software engineering agents by comparing execution trajectories. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Uses SWE-bench to train and evaluate agents rather than proposing a new benchmark methodology. | |
| Self-Preservation in Language Models Investigates self-preservation in language models by using task banks to steer synthetic replay during continual instruction tuning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on continual learning methods rather than an LLM evaluation benchmark or judge system. | |
| Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data Proposes a mesh-native tokenization approach to adapt foundation model architectures to unstructured scientific simulation data. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an architecture for physics data, not an LLM benchmark or evaluation methodology. | |
| Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building Benchmarks machine learning and pretrained foundation models for day-ahead electricity forecasting in a university building. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant An applied forecasting case study, not a benchmark or evaluation method for LLMs. | |
| Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller Demonstrates a backdoor attack where malicious reasoning degradation is triggered incrementally using invisible prompt tokens and stage tracking. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on introducing and demonstrating an attack mechanism, not an evaluation benchmark. | |
| CLEAT: Learning Value-Guided Clarification for Interactive Agents Co-trains an interactive agent's task policy with a clarification-value controller to optimize when to ask follow-up questions. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Develops a co-training framework for interactive agents rather than an evaluation benchmark. | |
| Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization Introduces a key-value cache compression method representing attention activations as sums of compact Kronecker products. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an attention architecture, not an evaluation framework or benchmark. | |
| MagicBeanStalk: Escaping the RLVR Zero Advantage Trap with Recursive Data Synthesis Analyzes zero-advantage training plateaus in reinforcement learning with verifiable rewards and proposes recursive data synthesis to address them. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Analyzes RLVR training data synthesis rather than proposing a general LLM evaluation benchmark. | |
| Incremental Retrieval-Augmented Generation for Human-in-the-Loop Decision Support Evaluates an incremental retrieval-augmented generation framework that progressively populates its knowledge base from human decision precedents. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents an incremental RAG system rather than a new evaluation framework or benchmark. | |
| Recurrent Harness for Agentic Continual Learning Proposes a recurrent harness framework that uses streaming feedback to revise textual memory for continual agent learning. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Evaluates on existing benchmarks rather than proposing a new evaluation methodology or benchmark. | |
| Unsupervised Multimodal Reward Modeling Trains an unsupervised vision-language reward model using intermediate layer representations and caption perturbations without human preference labels. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a training method for reward models rather than an LLM evaluation benchmark. | |
| KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting Develops a temporal encoder injecting engineering domain priors to forecast rare, high-cost events in multivariate time series. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Focuses on multivariate time-series forecasting models rather than LLM evaluation. | |
| Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data Constructs a multimodal simulator dataset and trajectory prediction model for autonomous driving in urban roadway work zones. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Introduces a driving trajectory dataset, not an LLM evaluation benchmark. | |
| Faithful and Complete LLM-Assisted Automated Construction of Hierarchical Hardware Knowledge Graphs Introduces an automated pipeline using language models to construct hierarchical knowledge graphs from complex hardware datasheets. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Presents a knowledge graph construction pipeline rather than an LLM benchmark. | |
| Semantic Views: Certified Reuse of LLM Labels Across Semantic Queries Presents a certified semantic filtering technique that reuses prior model labels to reduce language model calls in database queries. Preprint | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | Not relevant Addresses certified query processing in databases rather than LLM benchmarking or evaluation. |
3,181–3,240 of 3,345← PreviousNext →