Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Sensitivity or Criterion? Measuring and Moving When Language Models Act This paper introduces a diagnostic framework using signal detection theory to measure when language model agents decide to use tools. Ranked #181New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a diagnostic framework and benchmark for measuring model action decisions. | |
| SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition This paper introduces an evaluation benchmark that generates complex, long-horizon agent workflows by composing verifiable business skills. Ranked #182New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a benchmark and programmatic evaluator for measuring long-horizon agent task performance. | |
| DSABench: Benchmarking Source Discovery, Coordination, and Execution for Multi-Database Agents This paper introduces a benchmark to evaluate how language agents discover, coordinate, and query across multiple distinct databases to answer questions. Ranked #183New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a comprehensive benchmark evaluating discovery, coordination, and execution in database agents. | |
| Target-Token Asymmetry Can Masquerade As Depth Specialization The paper shows that differences in predicted target tokens, such as whitespace, can falsely look like layer specialization across different corpora. Ranked #184Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Demonstrates methodological pitfalls in layer-ablation evaluations across corpora. | |
| SEA-HELM Audio: Evaluating Multilingual ASR-LLM Pipeline Performance Across SEA-HELM Subsets The paper presents an audio evaluation benchmark assessing accuracy drops between speech-input and text-input pipelines in Southeast Asian languages. Ranked #185New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces an evaluation benchmark measuring performance degradation in multilingual ASR-LLM pipelines. | |
| Lost in Translation: Why Lower Bias Scores Don't Mean Fairer Models This paper evaluates multilingual bias audits across ten language models, showing that lower stereotype scores often reflect translation artifacts rather than fairer behavior. Ranked #186Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Critiques multilingual bias benchmarks, revealing why lower stereotype scores reflect translation noise. | |
| OpenTWBench (Open Taiwan Benchmark): Taiwan-Domain Knowledge Evaluation for Large Language Models, and How the Measurement Apparatus Shapes the Score The paper introduces a two-part benchmark to evaluate language models on general and examination knowledge concerning Taiwan. Ranked #187Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces an open evaluation suite and benchmark datasets for Taiwan-domain knowledge in LLMs. | |
| MemCut: Every Secret Leaves a Trail in the Long-Term Memory of LLM Agents The paper introduces a benchmark to evaluate whether language model agents reliably delete sensitive user data and secret evidence from memory upon request. Ranked #188New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces MemCut, a benchmark and metrics evaluating whether LLMs forget sensitive user data. | |
| From Unreliable to Usable: Decomposing Failure Modes and Confidence Signals in LLM Entity Extraction - Evidence from Cyber Threat Intelligence The paper evaluates failure modes and confidence calibration across frontier and lightweight language models during entity extraction from cyber threat intelligence reports. Ranked #189Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Conducts a frozen audit of LLM extraction and confidence calibration. | |
| Are AI Decision Models Biased? A Case Study of Jev The paper evaluates an artificial intelligence decision model across cognitive reflection, classical bias benchmarks, and pricing tasks. Ranked #190Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Audits cognitive, social, and statistical biases in AI decision-making models using behavioral benchmarks. | |
| CoRedSkill: Stealthy Skill Composition Attacks via AST-Guided Injection The paper presents a red-teaming method that injects stealthy attack operations across interdependent agent skills using code rewriting. Ranked #191New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents a benchmark evaluating agentic skill composition attack success. | |
| How GUI Agents Fail: GraceBench for Execution Stability Diagnosis The paper introduces an evaluation framework to diagnose step-level execution stability and error recovery in graphical user interface agents. Ranked #192New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces GraceBench to benchmark step-level trajectory stability and failure modes in GUI agents. | |
| Typed Decision Models on Tabular Data The paper compares typed probabilistic decision models with large language models on tabular data classification and format robustness. Ranked #193Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates LLM and decision model robustness under 21 input rewrite variations on tabular data. | |
| Evaluating Compressed Memory: Dependence, Utility, and Content Benefit The paper evaluates whether language models genuinely benefit from compressed memory by comparing them against memory-free baseline models. Ranked #194Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Reveals experimental flaws in how compressed memory and retrieval benefits are benchmarked and measured. | |
| Steering Vectors for Competing Ethical Frameworks Are Interchangeable: A Competing-Target Test for Activation Steering The paper introduces a test showing that steering vectors designed for competing ethical frameworks behave interchangeably in open-weight models. Ranked #195Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces the competing-target test to evaluate what activation steering vectors actually measure and control. | |
| Agentic Self-Awareness: Aligning Knowing, Acting, and Holding The paper benchmarks whether AI agents can recognize execution blockers and appropriately defer action on unsolvable tasks. Ranked #196New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Develops evaluation rubrics and benchmark tasks (Terminal-Bench 2.1) to test agent self-awareness. | |
| Beyond Aggregate Accuracy: Item-Level Transitions in Prompt Optimization Introduces a prompt optimization framework that monitors item-level regressions and recoveries rather than relying solely on aggregate accuracy. Ranked #197Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Exposes how aggregate accuracy conceals item-level regressions in prompt evaluation across standard benchmarks. | |
| Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams Argues that inferential accuracy fails to evaluate agent coordination safely because correlated errors can compound into costly team actions. Ranked #198New way to see a problemPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Critiques aggregate accuracy metrics for certifying inferential capabilities in multi-agent systems. | |
| CyberArena: Benchmarking AI Agents in Live Symmetric Attack-and-Defense Combat Presents a benchmark evaluating security agents through live, symmetric attack-and-defense competitions in isolated sandbox environments. Ranked #199New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a dynamic, symmetric adversarial benchmark evaluating autonomous agent capabilities. | |
| Why Static Skill Inconsistencies Do Not Equate to Runtime Risks: A Behavioral Analysis of LLM Agent Execution Analyzes discrepancies between static tool specification errors and actual runtime failure rates in language model agent execution. Ranked #200Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Provides an empirical benchmark and controlled evaluation pipeline assessing runtime agent skill performance. | |
| Manacá-1B-Instruct-2: Reproducible Safety Alignment for a Native Brazilian-Portuguese LLM. Negative DPO Results, a Controlled Composition Scan, and a Silent Failure Mode of the LLM Judge Documents safety alignment methods, negative preference tuning outcomes, and automated judge limitations for a Portuguese language model. Ranked #201Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Reports methodological findings and failure modes in LLM-as-a-judge evaluation of safety alignment. | |
| Into the Unknown: Benchmarking AI agents on open scientific research problems The paper introduces a benchmark to evaluate whether frontier language model agents can execute open scientific research and produce follow-up papers. Ranked #202New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a novel benchmark and rubric to evaluate AI agents on open scientific problems. | |
| LintEval: Benchmarking LLMs on Linter-Guided File Refactoring The paper presents a multilingual benchmark to evaluate how language models resolve linter alerts while preserving program functionality. Ranked #203New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Provides a new evaluation benchmark measuring functionality preservation during refactoring. | |
| Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversations The paper studies the durability of inference-time value steering in multi-turn conversations when user and model values conflict. Ranked #204Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a multi-turn evaluation setup to test whether inference-time alignment persists across conversations. | |
| PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information? The paper introduces a benchmark to evaluate whether language models can accurately detect appropriate and inappropriate uses of persona information in dialogue. Ranked #205New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces PersEvalBench to evaluate whether LLM-as-a-judge can reliably detect personalization errors. | |
| Similar Models, Broken Odds: Where Luce's Axiom Fails in Chatbot Arena The paper shows that the Bradley-Terry model fails on Chatbot Arena for similar models, and introduces a parameter-efficient correction for ties. Ranked #206Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Analyzes Chatbot Arena ranking dynamics and failure points of the Bradley-Terry benchmark model. | |
| Are We Really Measuring Forgetting? Pitfalls in Evaluating Machine Unlearning for Multimodal LLMs The paper identifies evaluation pitfalls in multimodal machine unlearning and introduces a benchmark grounded in real-world knowledge. Ranked #207Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Identifies evaluation pitfalls and introduces GEMMU, a benchmark for evaluating multimodal machine unlearning. | |
| What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities The paper analyzes post-training in audio-language models to separate genuine audio reasoning gains from question-format memorization. Ranked #208Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Exposes benchmark evaluation flaws where audio-language models exploit textual cues rather than genuine reasoning. | |
| Did the LLM Answer the Question? A Semantic Reconstruction Game for Jailbreak Evaluation This paper proposes a semantic reconstruction game to accurately evaluate jailbreak success by filtering out harmless repetitions and refusals. Ranked #209New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a new semantic reconstruction evaluation method to accurately benchmark jailbreaks. | |
| How Far Can Coding Agents Go in Visual Generation? The study evaluates coding agents generating images via executable code, analyzing their strengths in geometric constraints over photorealistic drawing. Ranked #210Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces AgentDrawBench to benchmark coding agents on visual generation and reasoning. | |
| When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents Introduces a benchmark to evaluate how language model agents learn and self-evolve reusable skills when exposed to non-adversarial noise. Ranked #211New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a benchmark measuring LLM agent skill self-evolution under non-adversarial noise. | |
| Shortcut Sensitivity in Agent-Safety Evaluations The paper introduces a framework to detect spurious shortcuts in safety benchmarks used to evaluate tool-using AI agents. Ranked #212Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Exposes shortcut cues and auditing flaws in existing agent safety evaluation benchmarks. | |
| Change the Number, Change the Answer: Assessing Rating Scale Sensitivity in LLM-Based Text Scoring The paper evaluates how choices in rating scale design systematically alter text evaluation scores produced by large language models. Ranked #213Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Analyzes reliability issues and sensitivity in LLM-based evaluation and scoring. | |
| Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems? The paper introduces a benchmark to measure language model agent performance under real-time latency and streaming temporal constraints. Ranked #214New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces Realtime-Bench to evaluate interactive models under dynamic latency constraints. | |
| PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents The paper trains language model auditors to detect multi-turn policy violations during tool use by autonomous agents. Ranked #215New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces an evaluation algorithm and benchmark setting to audit agent policy compliance. | |
| Prism-1: Position- and Rival-Independent Scoring for System One Models The paper evaluates single-pass decision models against rational choice axioms and identifies ordering and rival-option sensitivity failures. Ranked #216Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Evaluates systematic positional and choice-set biases in language model decision making. | |
| Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts The paper tests how language models weigh price momentum, commentary tone, and earnings surprises when forecasting financial outcomes. Ranked #217Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Designs a diagnostic evaluation protocol to test how LLMs weigh conflicting financial numerical signals. | |
| Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence The paper analyzes why search-augmented language models produce outdated answers even when relevant evidence is retrieved. Ranked #218Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Evaluates model unfaithfulness and citation accuracy on temporal benchmarks. | |
| DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents The authors present a benchmark to evaluate conversational agents that follow correct factuality but violate procedural task steps. Ranked #219New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces DialFork, a benchmark for evaluating procedural conversational failures. | |
| In the Guise of Correction: How Framing and Cultural Adaptation Erode LLM Safety on Real-World Criminal Cases Presents a benchmark based on real criminal cases showing how correction framings and cultural adaptations bypass safety guardrails. Ranked #220Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces GUISE, a benchmark evaluating LLM safety across framings and cultures. | |
| Poison Valleys: Diagnosing Path-Dependent Failure in LLM Code Repair Analyzes how misconceptions in early planning stages cause cascading failures during automated code repair by language model agents. Ranked #221New way to see a problemPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents diagnostic methods and synthetic test cases to evaluate code repair. | |
| Kolab: Benchmarking Human-Agent Collaboration in Long-Horizon Workflows Introduces a dataset benchmarking human-agent interaction and collaboration across long-horizon professional workflows. Ranked #222New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Provides a benchmark and evaluation framework for measuring human-agent collaboration quality. | |
| Sci$Π$vot: Benchmarking Principal-Investigator Judgment at Pivotal Moments of Scientific AutoResearch Agents Introduces a benchmark evaluating whether language agents can make correct scientific judgment calls derived from human interventions. Ranked #223Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a new 248-case benchmark for evaluating scientific judgment in autonomous agents. | |
| System1-Arena: Which Decisions Can Be Left to System 1? Introduces a benchmark evaluating single-forward-pass discrete decision models versus generative reasoning models across diverse closed-loop tasks. Ranked #224New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a 92k-question benchmark evaluating System-1 decision policies versus reasoning models. | |
| Does Latent Chain-of-Thought Actually Reason? A Single, Unifying Taxonomy for Latent Reasoning Investigates whether continuous latent reasoning tokens genuinely compute answers or merely settle early on predetermined conclusions. Ranked #225Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Critically assesses whether latent chain-of-thought models actually perform computation during reasoning. | |
| Judging the Judges: Confidence and Disagreement in Rubrics as Rewards Proposes an ensemble framework that weights judge confidence and masks disagreements when training models with rubrics as rewards. Ranked #226Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Addresses LLM-as-a-judge disagreement and confidence weighting in rubric-based evaluations. | |
| Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents The paper investigates performance vulnerabilities in self-improving agents when their co-evolved skill banks undergo post-deployment drift. Ranked #227New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces CODA, an evaluation protocol and new metrics for skill drift. | |
| Evaluating Model Capabilities After Benchmark Saturation Tests whether transcripts of correctly solved tasks from saturated benchmarks can predict model performance on unseen harder evaluations. Ranked #228New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Investigates extracting capability signals from model transcripts when standard benchmarks become saturated. | |
| The World Won't Wait: Evaluating and Teaching Agents Under a Live Clock Introduces a benchmark evaluating language model agents in real-time environments and a two-timescale training method to improve execution speed. Ranked #229Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces RealtimeBench to evaluate language models in dynamic, continuously running settings. | |
| PremiseSQL: Evaluating Premise Critique and Abstention in Text-to-SQL Systems Introduces a benchmark to evaluate whether text-to-SQL systems can detect flawed query premises and abstain from generating invalid SQL. Ranked #230New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents PremiseSQL, a benchmark evaluating premise critique and abstention in SQL generation. | |
| Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning Presents a benchmark that measures long-context reasoning difficulty using evidence scope, dispersion, and reasoning depth. Ranked #231New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces LURCH, a benchmark quantifying long-context reasoning difficulty. | |
| Effectiveness of Hidden-State Probes for Localizing Reasoning Failures Evaluates whether internal hidden-state probes can identify failure modes and pinpoint failing steps in multi-step reasoning traces. Ranked #232Surprising resultPeer-reviewed7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Evaluates the reliability of probe-based methods for diagnosing reasoning failures. | |
| WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents Introduces a benchmark that structures multi-pull-request code changes into dependency graphs to evaluate long-horizon software engineering agents. Ranked #233New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents a novel benchmark and dependency-consistent progress metric for agents. | |
| AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks The paper introduces a modular measurement system to evaluate how agent frameworks, tools, and memory impact verifiable reasoning tasks. Ranked #234Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a standardized measurement system to evaluate LLM agent components, behavior, and resource use. | |
| VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents Presents a benchmark with human-annotated visual evidence to evaluate retrieval and question answering across long documents. Ranked #235New testPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a large-scale benchmark for evaluating visual evidence grounding and QA. | |
| VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility The paper presents VoteGEO-Bench to measure how rewriting web content influences information visibility in generative search engine election queries. Ranked #236Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces VoteGEO-Bench to measure the impact of generative engine optimization on visibility. | |
| VALCON: Benchmarking and Enhancing Value Consistency in Large Language Models via Dual-Role Variation The paper introduces VALCON to evaluate and improve value consistency when language models alternate between generator and evaluator roles. Ranked #237Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Proposes VALCON benchmark suites to evaluate LLM value consistency across generation and evaluation. | |
| What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination The paper audits data decontamination methods on math corpora to quantify false removals and benchmark leakage risks. Ranked #238Surprising resultPreprint7/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Directly assesses benchmark contamination and data decontamination policies for models. | |
| OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding This paper introduces a benchmark to evaluate multimodal models on joint audio-visual temporal grounding, spatial grounding, and question answering. Ranked #239New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a benchmark evaluating multimodal video grounding and reasoning across multiple tracks. | |
| EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents Presents a simulation benchmark evaluating how embodied agents continually acquire basic skills and recombine them for complex tasks. Ranked #240New testPreprint6/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Presents EmbodiedCLBench, a benchmark designed to evaluate continual learning in embodied agents. |
181–240 of 3,345← PreviousNext →