Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| RuleTrek: Benchmarking Agentic Rule Reasoning in Complex Scenarios The paper introduces a multi-domain benchmark to evaluate language model agents on identifying, understanding, and applying domain-specific rules across complex files. Ranked #241New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces RuleTrek, a multi-domain benchmark evaluating LLM agents on rule identification and deduction. | |
| Data World: Scaling Data Environments from Scratch The authors present an engine to synthesize environments, tasks, and rubrics for training and evaluating data analysis agents. Ranked #242New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a standardized benchmark to measure data agent capabilities. | |
| DataVista: Diagnosing Multimodal LLMs on Data Video Understanding Introduces a benchmark evaluating multimodal language models on extracting data, tracking narrative flows, and answering questions from animated data videos. Ranked #243New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Presents DataVista, a new benchmark specifically diagnosing multimodal LLMs across 6,775 questions. | |
| Cowork-Gym: Synthesizing Interactive Work Environments at Scale Introduces Cowork-Gym, a framework synthesizing multi-tool collaborative work environments and user simulations to train enterprise agents. Ranked #244New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces synthesized benchmark environments to evaluate interactive agent performance. | |
| MA-Bench: Measuring Operational Planning in Language Models The paper introduces a benchmark assessing language models on operational planning from incomplete, complex, and contradictory military document sets. Ranked #245New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents a benchmark and rubric-based LLM-judge framework evaluating operational planning from documents. | |
| Choosing LLMs for Strategic Agent Interactions The authors formulate a meta-game framework to dynamically route and select language models during strategic multi-agent interactions. Ranked #246Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes how to reliably benchmark and measure strategic decision-making in LLMs. | |
| LeanPRM: Lean-Grounded Process Supervision for Natural Language Proof Verification Presents LeanPRM, a method using the Lean proof assistant to generate step-level correctness labels for training natural-language mathematical proof verifiers. Ranked #247New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces LeanPRM and LeanPRM-Bench for step-level natural language proof verification. | |
| Beyond the Verdict: Agentic Code Judging with Verifiable Feedback The paper introduces a benchmark and model for evaluating program correctness and generating diagnostic counterexamples for competitive programming code. Ranked #248New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces USACO-JUDGE benchmark to evaluate LLM verifier accuracy on competitive programming solutions. | |
| Recursive Environment Scaling for General Long-Horizon Agents Presents an environment scaling framework that alters dependencies to scale agent benchmark difficulty while preserving task objectives. Ranked #249New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Develops a methodology to scale benchmark difficulty for agent evaluation. | |
| Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR Proposes a severity-weighted character error rate that charges text transcription errors based on their practical impact on reader understanding. Ranked #250New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a new metric and benchmark for OCR evaluation. | |
| SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the Spire Presents a benchmark evaluating agentic large language models on long-horizon strategic reasoning in the game Slay the Spire. Ranked #251New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces SpireBench, a new benchmark evaluating long-horizon strategic play in agentic models. | |
| MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support Presents an evaluation framework combining simulated mental health patients and expert-developed rubrics to assess conversational language models. Ranked #252New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces MindEval2, an evaluation framework and rubric for mental health support models. | |
| Perception Test 2026: Challenge Summary and Extension to City-scale Audio-Visual Reasoning The paper introduces benchmarks and summarizes winning solutions for city-scale audio-visual reasoning and spatial intelligence at the Perception Test 2026. Ranked #253New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a benchmark challenge report evaluating spatial intelligence and multimodal reasoning. | |
| A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization Introduces AgenticBBO-Bench, a benchmark across multiple domains to evaluate LLM agents on black-box optimization under unified finite budgets. Ranked #254New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Proposes AgenticBBO-Bench, a new evaluation benchmark and protocol for measuring agentic black-box optimization. | |
| Grid-Bench: Can LLMs Predict How Discrete Worlds Change? Evaluates the ability of language models to predict state changes in discrete spatial grids across sequential operations. Ranked #255New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents Grid-Bench, a new benchmark testing spatial state-tracking capabilities in LLMs. | |
| Language-Specific Effects of Tokenizer Choice in Multilingual Language Models The paper trains 123 models across 54 tokenizers to show tokenizer choice matters more for languages with less training data. Ranked #256Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Empirically evaluates the cross-lingual performance effects of tokenizer choices across dozens of models. | |
| Thinking Outside the Bots: Human Ideas in AI's Semantic Blind Spots Are Not Inferior The paper develops an approach to map AI semantic blind spots and evaluates the quality of distinct human ideas. Ranked #257Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a methodology to benchmark and evaluate semantic coverage between humans and AI. | |
| SFT Leaves a Reproducible Signature in Activation Geometry: Calibrating Post-Training Interpretability Against Run-to-Run Noise Measures post-training activation geometry shifts against run-to-run noise, identifying distinct structural signatures left by supervised fine-tuning. Ranked #258New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes post-training interpretability evaluation, run-to-run noise, and benchmark calibration methodology. | |
| Rethinking Quality in Large Language Model Routing: Security-Conditioned Model-and-Budget Selection The paper proposes a query router that balances answer utility, security risks, and token budgets when selecting language models for mixed enterprise workloads. Ranked #259New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces SCRouterBench to evaluate model performance under security and budget trade-offs. | |
| Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels Proposes a spectral representation framework to attribute agent failures to specific decisive steps using only trajectory-level outcome labels. Ranked #260New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | On-topic Presents a method to evaluate and attribute step-level failures in LLM agent trajectories. | |
| SEAR: Self-Evolving Agentic Robotics The paper presents a framework and benchmark to evaluate whether self-evolving robotic agents genuinely learn reusable skills across tasks. Ranked #261New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a benchmark evaluating whether self-evolving robotic agents generalize across tasks. | |
| Beyond Bias Scores: Answerability Confounds in Activation Steering with Gradient-Constrained Direction Design (GCD) Shows that activation steering evaluations can conflate bias reduction with model abstention, introducing a gradient-constrained direction design to isolate preferences. Ranked #262Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes answerability confounds in the BBQ bias benchmark and proposes corrections. | |
| RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work The paper presents a simulated benchmark across eleven unconstrained environments to evaluate vision-language models on documenting real-world human physical work. Ranked #263New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents RealityBench, a new benchmark to evaluate vision-language models on documenting real physical tasks. | |
| Dissociating Answerability from Extraction in LLM Question Answering over Radiology Reports The paper introduces an evaluation method that separates question answerability detection from answer span extraction in radiology report question answering. Ranked #264New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Proposes a new benchmark evaluation methodology decoupling answerability from extraction in QA. | |
| Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress This paper updates a long-horizon terminal benchmark to measure sustained agent progress across complex engineering workflows using dense process rewards. Ranked #265New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents a benchmark measuring sustained agent progress and addressing evaluation infrastructure defects. | |
| From Hindsight to Foresight: Dissecting Clinical Evidence Acquisition in Large Language Models This paper analyzes dynamic clinical evidence gathering in language models, identifying failures in evidence identification, updating, and diagnostic reasoning. Ranked #266New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents a systematic framework dissecting and evaluating dynamic diagnostic evidence acquisition failures in LLMs. | |
| Evaluating Temporal Reasoning in Large Language Models: Event Temporal Relation Extraction with Allen's Interval Algebra, Logical Consistency, and Relative Time in Narratives The paper evaluates five language models on extracting complete interval networks of relative temporal events from narratives. Ranked #267New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces an evaluation protocol and benchmark testing LLM temporal reasoning and logical consistency. | |
| Empathy Is Not the Scapegoat for Declines in Factuality and Reliability Examines whether model empathy degrades reliability, showing that warm behavior effects depend on tasks and training approaches rather than an inevitable trade-off. Ranked #268Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents an 11-dataset benchmark suite and human-validated evaluators for factuality and empathy. | |
| How Reliable Are System-One Decisions in Medicine? A Comparative Study of Jev, Jev-like Models, and LLMs Evaluates fast, system-one decision models and language models across fifteen medical datasets, testing their accuracy, format robustness, and abstention awareness. Ranked #269Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Compares model decision stability and abstention across a unified 15-dataset medical benchmark. | |
| The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitization Introduces a benchmark evaluating how reliably software coding agents extract and digitize complex unstructured clinical trial protocol documents. Ranked #270New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces TrialPD-Bench to evaluate coding agents on long-document clinical trial digitization. | |
| ToolHACE: A Dataset for Detecting Hallucinations in Tool-Based LLM Responses This paper introduces a benchmark dataset to evaluate hallucination detection in language model responses after external tool execution. Ranked #271New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces ToolHACE, a span-level benchmark for evaluating hallucinations in tool-based responses. | |
| Towards Universal Calibration for In-Context Classification This paper presents a universal calibrator to improve confidence estimates of in-context classification without requiring model-specific fine-tuning. Ranked #272New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Focuses on measuring and improving model confidence calibration in in-context classification tasks. | |
| Lexical Redefinition Reveals Context-Sensitive Instruction Following This paper tests how language models handle explicit instructions when subsequent contextual sentences provide conflicting word definitions. Ranked #273Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents a behavioral evaluation paradigm to assess how LLMs follow conflicting in-context instructions. | |
| The Multilingual Artificial Hivemind: Do All LLMs Think Alike in Every Language? This paper investigates output diversity and text homogenization across twenty-three open-weight language models and thirteen languages. Ranked #274Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Evaluates multilingual text homogenization and diversity metrics across 23 language models. | |
| Learn from Move: the Next Step for GUI Agents This paper introduces an environment benchmark and exploration framework to help graphical user interface agents learn unfamiliar interaction dynamics. Ranked #275New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces LatentGUIWorld, a new benchmark evaluating exploratory GUI agents under partial observability. | |
| CivWorldBench: Evaluating Language World Models in Structured Multi-Agent Sandbox Worlds This paper introduces a multi-agent sandbox benchmark to evaluate language models on state inference, forecasting, and intervention prediction. Ranked #276New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces CivWorldBench, a structured benchmark evaluating language model world-modeling and forecasting. | |
| Unchecked or Falsely Accused? Evaluating AI-Generated Text Detectors on Kazakh This work evaluates machine-text detectors on Kazakh text using pre-ChatGPT human writing and shows significant false-positive rates. Ranked #277New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Presents a new benchmark and evaluation methodology for AI text detectors. | |
| Generalizable Model Editing Could Be More Than Direct Generalization The authors analyze limitations in direct model editing benchmarks and compare them against observed generalization in practical chat settings. Ranked #278Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Critiques prevailing evaluation paradigms for generalization in model editing. | |
| Re-executing Coding-Agent Evaluations: Unchanged Decisions and Unresolved Policy Risk The paper re-evaluates coding-agent benchmark results to measure sensitivity to test execution environments and grading configurations. Ranked #279Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Audits execution variance and stability in established coding-agent benchmarks. | |
| SciCurateBench: Curating Experimental Data from Heterogeneous Scientific Literature with Verbal-Action Agents The paper presents SciCurateBench to evaluate language models on verifying complex experimental conditions from unprocessed scientific literature. Ranked #280New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a benchmark evaluating data curation from scientific literature. | |
| OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools The paper presents OpenMobile-2, combining open mobile environments, trajectory datasets, and hybrid GUI-tool actions for mobile agents. Ranked #281New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces MobileGym++ Bench to evaluate complex, long-horizon mobile agent performance. | |
| Safety for Whom? Benchmarking Understanding Beyond Refusal in Egocentric Multimodal Assistants This paper introduces a benchmark to evaluate whether egocentric multimodal assistants understand who is harmed rather than solely tracking output refusal. Ranked #282New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents STOU, a new benchmark decoupling safety understanding from refusal behavior in multimodal assistants. | |
| Evidence-First Agentic Verification Introduces Sauron, an evidence-first agentic verifier that checks both environment state and execution traces against original sources to validate task rubrics. Ranked #283New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Provides a verifiable evaluation framework for long-horizon agentic task rubrics. | |
| A Baseline Assessment for the Agentic Web Technology Stack Benchmarks combinations of language models, communication protocols, and agent frameworks on web interaction tasks. Ranked #284New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Proposes MASTIF to benchmark multi-agent frameworks, protocols, and models on web tasks. | |
| SWE-Critix: Post-Training Generalist Verifiers for Assessing Coding-Agent Trajectories Proposes SWE-Critix, a post-training pipeline designed to train verifiers that evaluate and explain long coding-agent execution trajectories. Ranked #285New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Presents a learned verifier framework to evaluate complex, multi-step LLM agent trajectories. | |
| Pretraining and Test-Time Training Budgets Matter for ARC: A Controlled Study of VARC and TRM Evaluates how pretraining and test-time training computational budgets affect ARC benchmark performance across two distinct reasoning model architectures. Ranked #286Surprising resultPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Examines evaluation and training protocols to determine how pretraining and test-time training budgets impact ARC benchmarks. | |
| Constructing Pareto Frontiers of Optimal Reasoning Termination Methods for Overthinking in Reasoning Models Develops Step-wise Truncation Probing and termination strategies to quantify and mitigate accuracy degradation from overthinking in reasoning models. Ranked #287New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces Step-wise Truncation Probing and metrics to evaluate overthinking and measure theoretical mitigation potential. | |
| RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors Presents RESCUE, a counterfactual simulation framework to evaluate whether runtime failure monitor alarms enable beneficial robot interventions. Ranked #288New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces RESCUE, a counterfactual evaluation benchmark and framework for assessing robotic runtime monitors. | |
| When MLLMs miss what humans read: diagnosing and learning to read squint text Investigates multimodal LLM failures on squint-readable low-frequency text and provides a diagnostic benchmark alongside training interventions. Ranked #289New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces SquintBench and SquintCtrl to evaluate and diagnose visual text comprehension limits in multimodal models. | |
| Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing Presents a benchmark using real urban data to evaluate multimodal language models on spatial reasoning and constrained editing. Ranked #290New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces GeoSpatialBench, a comprehensive benchmark evaluating multimodal spatial reasoning. | |
| DRYLAB-Bench: Benchmarking the Biosecurity Risk of Agentic LLM Mutation Design Introduces a benchmark evaluating the risks of LLM agents designing dangerous biological mutations when augmented with biodesign tools. Ranked #291New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a comprehensive benchmark to evaluate biosecurity risks in agentic biodesign settings. | |
| CoBe: A Benchmark For Conversational Counterfactual Text Editing Presents a conversational benchmark testing whether models can edit text under counterfactual changes while preserving unaffected factual details. Ranked #292New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces CoBe, a novel benchmark evaluating zero-shot counterfactual text editing capabilities. | |
| Predicting Alignment Generalization with Value Representations Evaluates whether internal model representations can predict how fine-tuning on one value generalizes across other held-out values. Ranked #293New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Establishes a new evaluation task and benchmark for predicting model generalization across alignment targets. | |
| ReSI: Recursive Safety Improvement toward Resistant and Resilient AI Presents ReSI, a recursive safety framework using cyclical evaluation and updates to improve AI resilience against emergent threats. Ranked #294New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Develops an automated red-teaming and safety evaluation framework to benchmark model updates. | |
| InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewers Presents a simulated participant environment to evaluate multi-turn AI interviewers across market research and social science scenarios. Ranked #295New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a simulated environment and report card benchmark specifically to evaluate AI interviewer performance. | |
| OccludeBench: Can VLMs Find What's Missing? The paper presents a benchmark evaluating how effectively vision-language models recover fully occluded objects using remaining visual cues. Ranked #296New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces OccludeBench, a curated benchmark evaluating visual reasoning on occluded objects. | |
| Not All Correct Fixes Run Alike: An Empirical Study of Patch Performance in Repository-Level Issue Resolution The paper analyzes the runtime performance differences of test-passing issue resolution patches generated by language models on SWE-bench. Ranked #297New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Investigates repurposing FAIL_TO_PASS tests as a benchmark evaluation metric for patch performance. | |
| Personalization Without Stereotyping: Do Speech LLMs Know When to Turn a Deaf Ear? The paper introduces a benchmark to measure demographic robustness, stereotyping, and intentional personalization in speech language models. Ranked #298New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces BASIS-Bench, a benchmark measuring demographic robustness, stereotypical bias, and personalization. | |
| What Output-Only Review Cannot Verify: Study Contracts for Research Agents Proposes study contracts to register execution obligations and verify research agent outputs against approved protocol parameters. Ranked #299New way to see a problemPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Focuses on diagnostic verification and defect-checking methodology for automated research outputs. | |
| MultiWorldBench: Do Independently Controlled Views Describe One Shared World? Introduces a Minecraft diagnostic benchmark testing whether multiplayer world models maintain consistent and persistent representations across independently controlled views. Ranked #300New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a diagnostic benchmark to test consistency across views in world models. |
241–300 of 3,345← PreviousNext →