Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Text-Only vs. Image-Aware VLM Judges for Manga Translation Evaluation The paper evaluates whether providing page images to vision-language models improves the detection of errors in Japanese-English manga translation. Ranked #421Surprising resultPeer-reviewed5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Investigates LLM/VLM-as-a-judge methodologies and evaluation divergence between text-only and image-aware translation judges. | |
| Beyond Model Bias: Cross-Entropy Based Rankings in Literary and Academic Texts Remain Stable across Small Language Models This paper studies cross-entropy surprisal metrics, showing that predictability rankings of texts remain consistent across multiple small language models. Ranked #422Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes the stability and reliability of cross-entropy surprisal metrics across models. | |
| SIREN: Situation-aware Index for Response and Emergency ActioNability in Crisis Translation This paper introduces an evaluation index to measure whether machine translation of emergency communication preserves critical safety actionability. Ranked #423New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces SIREN, a human evaluation framework for assessing crisis translation actionability. | |
| Uncertainty Evaluation: Bridging Machine Learning and Measurement Science The paper examines conceptual parallels between measurement science and machine learning uncertainty evaluation to propose a more unified assessment framework. Ranked #424New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Proposes a metrology-based framework to systematically evaluate predictive uncertainty in machine learning. | |
| What Do Sparse Autoencoder Feature Discovery Scores Identify? From Activations to Interventions This paper compares observational feature discovery scores in sparse autoencoders against actual causal intervention effects on model outputs. Ranked #425New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Evaluates methods for identifying and measuring sparse autoencoder features. | |
| A Global View of How LLMs Value Human Time The paper evaluates how commercial language models value human time by measuring recommended delay compensation amounts across 193 different countries. Ranked #426Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Assesses and benchmarks how different LLMs assign economic value to human time across countries. | |
| Rate-Resolved Text Evaluation with Masked Diffusion Language Models The paper introduces rate-resolved text evaluation to turn masking rates in diffusion language models into diagnostic scores for text assessment. Ranked #427New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Proposes a rate-resolved evaluation framework for diagnosing text generation. | |
| A Persian Vision-Language-Action Dataset and Benchmark for Ambiguity- and Infeasibility-Aware Instruction-to-Plan Grounding The paper introduces a Persian vision-language-action dataset and benchmark to evaluate robotic instruction grounding under deliberate ambiguity and infeasibility. Ranked #428New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a benchmark, dataset, and evaluation metrics for instruction grounding. | |
| Feedback as an Interface: Controlling Form and Detail in LLM Translation Refinement The paper investigates how varying the detail and format of feedback affects machine translation refinement in large language models. Ranked #429Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Studies feedback formatting protocols and LLM evaluator-guided translation scoring. | |
| Can Language Models Play the Wikipedia Game? Tests language models on graph-based information retrieval and navigation using the Wikipedia Game across multiple languages and citation datasets. Ranked #430New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Evaluates and benchmarks multiple language models on a standardized information-navigation task. | |
| SqueezeBench: Saturation-Resilient Evaluation of Mathematical Capability Introduces SqueezeBench, a saturation-resilient benchmark for formal mathematical reasoning where new accepted proofs dynamically raise the target bounds. Ranked #431New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces SqueezeBench, a benchmark designed specifically to overcome benchmark saturation in mathematics. | |
| MAGMA-Bench: Evaluating Long-Horizon Embodied Agents under Dynamic Tasks and Execution Failures Introduces MAGMA-Bench to evaluate long-horizon embodied agent reasoning during dynamic task execution failures and multi-robot coordination. Ranked #432New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces MAGMA-Bench, a new benchmark evaluating embodied multi-robot agents under dynamic perturbations. | |
| MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation Presents a benchmark to evaluate language models on generating mathematical figures and diagram-assisted reasoning across frontier problems. Ranked #433New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces MathVis, a new benchmark and rubric suite evaluating reasoning via figure generation. | |
| VIGOR: Verifiable Industrial Geometry Optimization and Repair in Scene Programs Introduces an execution-grounded dataset and method to repair geometric and engineering constraint violations in LLM-generated industrial scene programs. Ranked #434New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a verifiable dataset and execution-grounded geometric checks to evaluate scene generation. | |
| Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination Audits audio-language model hallucination mitigations by testing localized acoustic evidence ablation against baseline methods across model architectures. Ranked #435New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Develops a black-box causal audit and evaluation method to measure audio grounding and hallucination. | |
| Examining Social Attribution in LLM Reasoning: A Theory-Guided Probing Methodology Proposes a benchmark and probing methodology based on attribution theory to examine how language models assign responsibility and blame. Ranked #436New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a new benchmark and probing methodology to evaluate social attribution reasoning in LLMs. | |
| Evaluating Exact Output and Checkpoint-State Prediction in Real Programs Evaluates language models on predicting program outputs and intermediate loop checkpoint states directly from source code and inputs. Ranked #437New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Presents a new benchmark and experimental protocol for evaluating model reasoning on code execution. | |
| Training User Simulators with Latent Intrinsic Feedback The paper trains conversational user simulators equipped with latent evaluation thoughts and scalar ratings to provide intrinsic feedback. Ranked #438New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Uses latent intrinsic feedback to evaluate conversational assistants and correlates with human judgments. | |
| Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs The paper benchmarks a specialized decision model against general-purpose LLMs on English and Chinese stance detection tasks. Ranked #439Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Evaluates specialized decision models against general-purpose LLMs across stance detection benchmarks. | |
| From Structure to Validity: Mechanism-Guided Generation and Refinement of LLM Rubrics Analyzes rubric construction mechanisms and introduces a tree-search method to refine rubrics for evaluating language model outputs. Ranked #440New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Investigates rubric design, refinement, and scoring criteria for LLM evaluation. | |
| What Do Audio-Language Judges of Generated Music Listen For? Four Probes with Controls from Expert Ratings Designs diagnostic probes to determine whether audio-language evaluation models judge music based on audio or prompt content. Ranked #441New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Investigates biases and evaluation reliability in audio-language model-as-a-judge frameworks. | |
| FastBench: Can Streaming VLMs Perceive High-Dynamic Real-World Streams? Introduces a benchmark evaluating streaming vision-language models on fast-moving, high-dynamic events in real-world video streams. Ranked #442New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces FastBench, a QA benchmark designed to evaluate streaming VLMs on high-dynamic video. | |
| Who Receives Respect? A Counterfactual Benchmark for Honorific Allocation Bias in Bengali This paper introduces a counterfactual benchmark to evaluate honorific register allocation bias across gender and occupations in English-to-Bengali translation. Ranked #443New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a counterfactual benchmark to evaluate honorific allocation bias in LLMs. | |
| Evaluating Bias in Chinese Large Language Models across Tasks and Registers: Task Operationalization Effects and Irony Classification Risks This paper audits Chinese language models for bias and error propagation across formal and ironic social registers. Ranked #444Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Audits evaluation fragility and operationalization across tasks and registers. | |
| ChemExplain: A Multimodal Benchmark for Explanatory Chemical Reasoning Presents a multimodal benchmark testing whether models can explain observed chemical effects by linking structural features to reaction mechanisms. Ranked #445New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces ChemExplain, a multimodal explanatory reasoning benchmark. | |
| FRACTION: Fraud Explanation Generation via Agentic Graph Context Navigation This paper presents an agentic framework and an evaluation rubric for generating explanations of risk labels in graph fraud detection. Ranked #446New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a validated evaluation rubric and protocol for assessing LLM-generated fraud explanations. | |
| How to Build a Benchmark That Actually Measures Taste This paper introduces a pairwise evaluation benchmark and protocol designed to measure subjective aesthetic taste while controlling for shortcut artifacts. Ranked #447New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a new benchmark and evaluates biases and construction artifacts in model evaluation. | |
| IND-Eval: Aligning Evaluation and Simulation for Industrial Time Series Foundation Models The paper introduces an industrial time-series forecasting benchmark to evaluate foundation models on multi-rate and multivariate data. Ranked #448New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a public evaluation benchmark for industrial time series models. | |
| AI-Assisted Tumor-Growth Law Discovery from Sparse Data: Refitting and LLM-Based Ranking The paper evaluates symbolic regression, refitting techniques, and language model rankings for inferring tumor-growth laws from sparse observation data. Ranked #449Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Evaluates LLM reasoning and ranking capabilities for scientific equation discovery. | |
| Improving the Evaluation of Biomedical Question Answering with Few Human Preference Signals This paper uses limited human preference signals to calibrate automated evaluation metrics for biomedical retrieval-augmented question answering. Ranked #450New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Proposes calibrating automated evaluation metrics with human preferences to evaluate QA systems. | |
| XForecast: The KDD 2026 Finance Day Challenge on News-Grounded Financial Forecasting This paper introduces a financial forecasting benchmark and competition that evaluates four-week stock movement predictions using both prices and news. Ranked #451New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Introduces a financial forecasting benchmark and metric evaluating multimodal time-series and news text integration. | |
| PATTERN Can Be Solved from Memory: Generator-Aware Baselines for Synthetic Node Classification Shows the PATTERN graph benchmark can be solved by memorization because pattern subgraphs are reused across splits. Ranked #452Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Exposes fundamental data leakage and design flaws in synthetic graph benchmarks. | |
| Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization This paper evaluates human opinion measurement interfaces and recommends listwise preference collection for human-in-the-loop optimization. Ranked #453New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Investigates user interface designs and human evaluation protocols for assessing model outputs. | |
| One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models The paper shows that one-step prediction accuracy in joint-embedding world models is an unreliable indicator of downstream planning performance. Ranked #454Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates whether one-step prediction metrics reliably reflect planning performance in world models. | |
| LIBERO-RIG: A Hardware-Setup Robustness Benchmark for Vision-Language-Action Models The paper introduces a benchmark to measure vision-language-action model robustness against hardware, optical, and physical robot setup variations. Ranked #455New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces LIBERO-RIG, a standardized benchmark evaluating policy robustness under hardware setup changes. | |
| GIFT-Eval-CTX: A Benchmark For Contextual Forecasting Model Evaluation This paper introduces a benchmark to evaluate whether forecasting models can incorporate forward-looking contextual information into accurate time-series predictions. Ranked #456New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents GIFT-Eval-CTX, a dedicated benchmark for evaluating contextual time-series forecasting across models. | |
| Monitoring latent reasoning in looped language models This paper presents an interpretability protocol to monitor latent reasoning dynamics and stability across multiple looped language model families. Ranked #457New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces an interpretability evaluation protocol to assess looped language models. | |
| DuplexAct: How Interactive Are Frontier Full-Duplex Spoken Language Models? This paper presents a benchmark with an action taxonomy to evaluate the interactive conversation capabilities of full-duplex spoken language models. Ranked #458New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces DuplexAct, a structured benchmark evaluating interaction actions in full-duplex spoken language models. | |
| MMTA: Benchmarking Multimodal Temporal Analysis with Time Series, Text, and Vision Releases MMTA, a multimodal benchmark testing the ability of language models to jointly analyze time series, text, and visual data. Ranked #459New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a comprehensive benchmark evaluating multimodal models on time series, text, and visual data. | |
| Know-Thy-Not: Training-Free Targeted Negation in Dual-Encoder Vision-Language Models The paper introduces a training-free technique and benchmark to help vision-language models correctly process and reject negated concepts in text prompts. Ranked #460New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces the COCO-Confusion benchmark to evaluate negation in vision-language models. | |
| HelpMeOut: A Neuropsychology-Grounded Benchmark for Error-Aware Monitoring of Household Task Execution Introduces HelpMeOut, an embodied AI benchmark for diagnosing human execution errors across household activity trajectories motivated by neuropsychology research. Ranked #461New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces HelpMeOut, a benchmark for evaluating error-aware monitoring of task execution. | |
| Beyond Successful Play: Diagnosing Opponent Modeling in Large Language Models The paper introduces a diagnostic framework to test whether language model agents genuinely infer opponent beliefs rather than following superficial behavioral patterns. Ranked #462New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents a benchmark framework diagnosing theory of mind in language models. | |
| PatTransBench: an ipc-stratified, multi-dimensional benchmark for patent machine translation evaluation Presents an evaluation benchmark and multi-dimensional protocol for patent machine translation across Chinese, English, Japanese, and Korean. Ranked #463New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a stratified multi-dimensional benchmark and evaluation protocol for patent machine translation. | |
| CryptoFlowBench: Benchmarking Multi-Hop Reasoning on Blockchains for Cryptocurrency Fund Tracing Introduces a benchmark and tool-augmented agent for evaluating multi-hop reasoning in cryptocurrency fund tracing. Ranked #464New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Presents a benchmark spanning multi-hop reasoning tasks for cryptocurrency transaction tracing. | |
| ScreenASR-Bench: A Tiered Benchmark for Speech Recognition with Visual Context Introduces a tiered benchmark to assess how explicit and implicit visual evidence helps speech recognition models resolve ambiguous words on screens. Ranked #465New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces ScreenASR-Bench to evaluate models across multimodal context tiers. | |
| GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning? Introduces a benchmark evaluating how and when multimodal language models perceive human social cues from partial audio and video snippets. Ranked #466New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces GesBench, a new benchmark testing cue-level social perception in multimodal models. | |
| SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation Develops a lightweight situational distortion metric to evaluate speech recognition errors based on practical conversational severity. Ranked #467New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Proposes a new situational distortion metric and validation protocol for evaluating speech transcription. | |
| Twenty Days Later: A Pre-Registered Test of History-Based Forecasts of Brand Mentions in Gemini Answers The paper reports a pre-registered test measuring the stability of history-based forecasts for model brand mentions over twenty days. Ranked #468Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Evaluates temporal reliability and forecast durability of LLM-generated brand mentions across multiple languages. | |
| Can LLMs Access their World Knowledge for Event Prediction? The authors introduce DescribeEvent to show that language models can forecast temporal events when using natural-language descriptions and symbolic labels. Ranked #469New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces the DescribeEvent benchmark to evaluate how language models predict temporal events. | |
| Beyond LLM Judge: Mechanical Verification for Agentic Autoformalization Combines language model review with mechanical numerical checks to verify mathematical formalizations and catch errors missed by automated judges. Ranked #470New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces mechanical verification to replace LLM judges in formal verification. | |
| PerSo: Investigating Facets of LLMs' Social Intelligence in Real-World Persuasion Scenarios Introduces a benchmark based on real online discussions to evaluate both cognitive and behavioral persuasion skills in language models. Ranked #471New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a new benchmark evaluating social and cognitive intelligence. | |
| ReFormBench: Benchmarking the Stability of Response-Conditioned Format Correction in Large Language Models The paper presents a benchmark evaluating how reliably language models correct and maintain formatting requirements across changing instructions. Ranked #472New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces ReFormBench to evaluate instruction compliance and format correction stability in LLMs. | |
| Interlock: From Local Correctness to Task Completion in Long-Horizon Agents The paper proposes a graph-based task synthesis framework to help long-horizon agents satisfy inter-dependent constraints and achieve complete task outcomes. Ranked #473New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Provides a graph-based framework and agent-as-judge evaluation for long-horizon task completion. | |
| Frame Evidence:A Benchmark for Reference Frames and Visual Evidence in Multi-Image Spatial Reasoning The paper introduces a spatial reasoning benchmark to evaluate how models handle varying reference frames and altered visual evidence. Ranked #474New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces Frame Evidence, a benchmark evaluating spatial reasoning consistency and failure modes in models. | |
| From Copying to Composition: How Language Models Develop In-Context Learning Analyzes how language models develop in-context learning by separating simple demonstration copying from multi-token rule composition across training checkpoints. Ranked #475New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents a controlled diagnostic evaluating how language models acquire and resolve in-context demonstrations. | |
| Not All Criteria Matter: Importance-Aware Criteria Weighting for Rubric-Based LLM Evaluation The paper introduces a method that weights rubric criteria through pairwise model comparisons to improve evaluation accuracy. Ranked #476New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes an importance-aware criteria weighting method for rubric-based LLM evaluation. | |
| MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation The paper presents a diagnostic evaluation framework to measure how inference-time techniques affect parametric knowledge extraction in models. Ranked #477New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a diagnostic evaluation framework to measure how inference techniques affect parametric knowledge extraction. | |
| From Efficiency to Sufficiency: The Cost-Aware Measurement Design Framework for Automated Essay Scoring The paper presents a framework to formalize compute, labor, and workflow costs as core measurement design criteria for automated essay scoring. Ranked #478New way to see a problemPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Proposes a framework to evaluate deployment costs and defensibility in scoring. | |
| Knowledge That Is Linear Before Fine-Tuning Generalizes After It The authors study why certain linearly represented facts in language models support generalization to new relations after fine-tuning while other recalled facts do not. Ranked #479Surprising resultPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Provides an empirical evaluation methodology predicting whether model knowledge generalizes across relations. | |
| From Research Goals to Scientific Closure: Evaluating Agents Through Evidence-Supported Physics Research Introduces a benchmark evaluating whether language model agents can independently direct and validate goal-specified physics research investigations. Ranked #480New testPreprint5/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces PhysClosureBench, a benchmark to test agent performance on research closure. |
421–480 of 3,345← PreviousNext →