Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · LLM evaluation and benchmarks — nothing is hidden. Brief papers first.
All3,345In brief3More (on-topic)587Not relevant2,721Not assessed24Older45Could not confirm25Blogs with no paper54All blogs57
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Bayesian Learning to Select Fair Classifiers The paper presents an online Thompson Sampling bandit policy to select classifiers that balance predictive accuracy and subgroup fairness under delayed feedback. Ranked #541New way to see a problemPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents an online evaluation policy balancing performance and subgroup fairness across agents. | |
| What Does Disagreement Mean? A Semantic Identifiability Frontier for Pairwise Preference Learning This paper establishes theoretical limits on what forms of annotator disagreement can be identified from pairwise preference feedback data. Ranked #542New way to see a problemPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Analyzes how annotator disagreement impacts preference data identifiability, informing evaluation dataset design. | |
| Evaluating Inquiry Learning in LLM-Based Agents: Hypothesizing, Reasoning, and Exploration The authors present an interactive environment to evaluate how language models integrate exploration, hypothesis generation, and reasoning. Ranked #543New testPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a structured interactive benchmark for testing LLM inquiry abilities. | |
| Rubric Judgments Lack Uncertainty: Conformal Weighting for LLM Evaluation Proposes conformal calibration to weight criterion-level uncertainty when using rubric-based language model judges for reinforcement learning. Ranked #544New way to see a problemPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents a conformal calibration method to handle uncertainty in LLM-as-a-judge rubric evaluations. | |
| PEDBench: Can Speech Models Detect Phonetic Errors? Introduces a benchmark combining natural, scripted, and synthetic audio to evaluate phonetic error detection in speech models. Ranked #545New testPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces PEDBench, a new benchmark evaluating speech models on phonetic error detection. | |
| KBS: A Korean Benchmark Suite for Foundation Model Evaluation The paper introduces the Korean Benchmark Suite to evaluate foundation models across six natural language capabilities. Ranked #546New testPreprint4/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces a comprehensive benchmark suite to evaluate foundation models on Korean. | |
| ClaimScope: Label-Blind Witness Verification for Mathematical Claim Auditing The authors introduce a benchmark to audit mathematical claims and repair errors using an automated witness verification checker. Ranked #547New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Introduces ClaimScope, a new 72-task benchmark for auditing mathematical claims. | |
| Swiss4Arg: A Parallel Dataset for Multilingual Argument Mining across Swiss National Languages The paper introduces Swiss4Arg, a multilingual argument mining dataset based on official Swiss voting brochures across four national languages. Ranked #548New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a new multilingual benchmark and dataset for evaluating argument mining across Swiss national languages. | |
| Lüshi-1840: Building and Probing a Knowledge Cutoff for a Classical Chinese Language Model This paper introduces Lüshi-1840, a pre-modern Chinese language model trained on historical texts to evaluate knowledge cutoffs and hindsight bias. Ranked #549New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Probes knowledge cutoffs, dataset curation pipelines, and temporal data contamination in models. | |
| Evaluating Semantic Relation Knowledge through Bidirectional Relation Prediction from Gloss Pairs The paper introduces a bidirectional gloss-pair prediction task to evaluate semantic relation knowledge across multiple languages in language models. Ranked #550New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Proposes a benchmark dataset evaluating bidirectional semantic relation consistency. | |
| UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes Introduces a Ukrainian meme dataset and evaluates vision-language models on detecting persuasive and propaganda techniques. Ranked #551New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces a new benchmark dataset to evaluate vision-language models on persuasion detection. | |
| QTestBench: A Test Framework for Evaluating LLM-Generated Quantum Code The paper introduces a benchmark framework evaluating LLM-generated quantum software unit tests against independent ground-truth checkers. Ranked #552New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces QTestBench, a framework for evaluating LLM-generated code test suites against checkers. | |
| BLiMPPI: Benchmark of Linguistic Minimal Pairs for Polarity Items The paper presents a multilingual benchmark of minimal pairs to evaluate language model sensitivity to negative polarity items across 33 languages. Ranked #553New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces BLiMPPI, a multilingual evaluation benchmark of minimal pairs across 33 languages. | |
| EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions The authors introduce a benchmark evaluating egocentric video understanding structured around an interactive loop of user perception, action, and world feedback. Ranked #554New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a structured video question-answering benchmark to evaluate multimodal models. | |
| A dataset of formalised theorem statements from the Annals of Mathematics AnnalsChallenge provides 50 formalized mathematics theorem statements in Lean 4 drawn from papers published in the Annals of Mathematics. Ranked #555New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a dataset of formal theorem statements to benchmark autoformalisation progress. | |
| How Reliable Are Large Language Models for Soil Organic Carbon Assessment? An Australian Benchmark The paper evaluates seven language models on estimating soil organic carbon concentrations, calculating carbon stock, and comparing agricultural paddock pairs. Ranked #556New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a benchmark evaluating LLM reliability and calculation accuracy on soil data. | |
| Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites The paper introduces a dataset and benchmark to evaluate vision-language models on recognizing and answering questions about Philippine cultural heritage sites. Ranked #557New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces Tanawpamana, a 4,046-task benchmark evaluating vision-language model knowledge. | |
| SarcasTraps: Effect of Sarcasm on Turkish Hate Speech Detection The paper evaluates the impact of sarcasm on Turkish hate speech detection models using a targeted external test dataset. Ranked #558New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a targeted test set to evaluate language models on sarcastic hate speech. | |
| CSWBench: Evaluating Context-Sensitive Code-Switching in Creative Writing The paper introduces a benchmark and evaluation framework assessing context-sensitive code-switching by language models in creative writing tasks. Ranked #559New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a benchmark evaluating context-sensitive linguistic code-switching in creative writing. | |
| Articulation Upper Bounds for Language Models The paper introduces prompt optimization and recovery measurement tools to evaluate the limits of transmitting concepts between scaling language models. Ranked #560New way to see a problemPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces measurement tools and scaling evaluations for concept articulation limits in LLMs. | |
| How Do LLMs Understand Legal Philosophy? Diagnosing Legal-Philosophical Reasoning in LLMs The paper introduces a benchmark to evaluate how well language models understand legal philosophy and apply it to legal reasoning. Ranked #561New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Presents a benchmark evaluating legal-philosophical reasoning in language models. | |
| PREFER: From Player Experience to Personalized Game Refinement The paper introduces a framework using psychometric dimensions and player personas to benchmark how language models evaluate and refine video games. Ranked #562New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a framework and psychometric benchmark for evaluating gameplay using LLM-based playtesters. | |
| NEPSEE: A Double-Annotated Benchmark for Nepali Sentiment Analysis The paper presents a double-annotated sentiment dataset for Nepali and evaluates several open-source and commercial language models on it. Ranked #563New testPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Introduces a double-annotated benchmark dataset for evaluating sentiment analysis models. | |
| Two Sample Sizes in Test-Time LLM Ensembling: Buffered ERM and Minimax Theory The authors analyze theoretical sample-complexity tradeoffs between questions and generations when ensembling multiple language models at test time. Ranked #564New way to see a problemPreprint3/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:18 | On-topic Develops theoretical risk bounds and sample-size analysis for test-time scaling and ensembling of LLMs. | |
| VETNET: Assembling Benchmark Datasets for AI-Driven Veterinary Innovation This paper presents an ecosystem of benchmark datasets and evaluation frameworks to advance machine learning applications in veterinary medicine. Ranked #565New testPreprint2/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces standardized benchmark datasets and evaluation frameworks for animal science AI. | |
| Neither True nor False: Do LLMs Represent Truth-Value Gaps in Plural Predication? The paper introduces HomogeneityNLI to evaluate whether open-weight language models recognise truth-value gaps in plural predication. Ranked #566New testPreprint2/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Presents a diagnostic dataset evaluating truth-value representations in LLMs. | |
| UA-Bench: Benchmarking Large Audio-Language Models on Underwater Acoustic Recognition The paper introduces a large-scale benchmark of synthetic underwater audio records to evaluate audio-language models on acoustic recognition tasks. Ranked #567New testPreprint2/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a large-scale benchmark for testing audio-language models on acoustic tasks. | |
| Are We Testing Too Much? A Survey of Benchmark Compression for Efficient Evaluation of Large Language Models Surveys methods for compressing large language model benchmarks to reduce evaluation costs while maintaining accurate score estimates. Ranked #568Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Surveys benchmark compression and methods for efficient, reliable LLM evaluation. | |
| Unreliable Narrator Framing as a Cost-effective Mechanism for Satire Explanation of Australian and American Satirical News Evaluates whether framing explanations around unreliable narrator theory enables open-weight models to explain satirical news cost-effectively. Ranked #569Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces an evaluation benchmark and dataset specifically designed to assess LLM satire explanation. | |
| Human and LLM Facilitation in Collaborative Design Meetings: A Computational Behavioral Comparison Compares human and Llama 3.1 8B facilitation turns across design meeting transcripts using multiple computational behavioral metrics. Ranked #570Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:29 | On-topic Compares human versus LLM conversational behavior and facilitation using behavioral metrics. | |
| Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-pop The paper analyzes aesthetic judgments by foundation models on K-pop music videos to measure inter-model consensus across audio and visual modalities. Ranked #571Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes foundation models acting as aesthetic judges, evaluating inter-model agreement and ranking consensus. | |
| Do LLM Tutors Actually Teach? A Process-Centered Synthesis of the Tutoring Loop This paper synthesizes literature on educational language models to evaluate whether tutoring systems measurably improve student learning gains. Ranked #572Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Audits evaluation practices and human learning measurements for LLM tutors. | |
| A Local Agentic AI Framework to Generate Edge Case Scenarios for Safety Assurance Presents a local agentic framework using smaller language models to automatically synthesize edge-case testing scenarios for autonomous systems. Ranked #573Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Develops an automated agentic framework to generate evaluation test cases for validating autonomous systems. | |
| BrickBench: Evaluating Agentic Brick Design Introduces a benchmark and environment for evaluating coding agents on text-conditioned LEGO design with physical and discrete assembly constraints. Ranked #574Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Proposes BrickBench, a new benchmark for evaluating agents on complex constraint-satisfaction design tasks. | |
| MindFlow: Mind Supernet Powered Thinking Flows for Research Idea Innovation Proposes a framework modeling research ideation as modular thinking flows sampled dynamically from a probabilistic supernet. Ranked #575Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Introduces an evaluation protocol and relative ranking framework to assess generated research ideas. | |
| Revisiting Accent Classification with DistilHuBERT: Speaker-Disjoint Evaluation and Cross-Corpus Generalization Evaluates DistilHuBERT-based accent classification under speaker-disjoint and cross-corpus conditions to measure generalization to unseen speakers. Ranked #576Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Studies evaluation methodology, dataset leakage, and generalization benchmarks in speech models. | |
| Forecasting Corpus-Sampling Disagreement in Masked Text Reconstruction Derives a formula to forecast disagreement between masked text reconstruction models fitted on independent samples from the same population. Ranked #577Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Examines corpus disagreement and evaluation stability under different pretraining samples. | |
| perturber: A Stateless Service for Semantics-Preserving Text Perturbations Presents a stateless service and library providing isolated, semantics-preserving text perturbations for language model robustness testing. Ranked #578Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 12 Oct, 16:28 | On-topic Provides a tool specifically to measure and correct overestimation in LLM evaluation benchmarks. | |
| TeachGrade: Training-Free Short Answer Scoring with Teacher Evidence This paper proposes a training-free framework that uses teacher-graded examples and dual memories to improve automated short answer grading. Ranked #579Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Addresses multi-subject, multi-step scoring consistency using LLM-as-judge frameworks. | |
| From a Large-Scale Teacher to Efficient Multimodal Students for Search Relevance Prediction The paper distills an LLM-based search relevance judge into smaller multimodal student models for efficient e-commerce search evaluation. Ranked #580Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:18 | On-topic Develops and validates an LLM-as-a-judge pipeline for automated relevance judgment and annotation. | |
| A Comparative Evaluation of RAG Architectures for Cross-Domain LLM Applications: Design, Implementation, and Assessment Compares sparse, dense, hybrid, and fusion RAG architectures across GPT-4o and LLaMA deployments using the RAGAS evaluation protocol. Ranked #581Peer-reviewed0/10 suggested | LLM evaluation and benchmarks via ieee · 12 Oct, 16:30 | On-topic Compares RAG architectures using the RAGAS evaluation framework and cross-domain benchmark metrics. | |
| Security in LLM-Assisted Coding: A Systematic Literature Review This systematic review analyzes security vulnerabilities, benchmark shortcomings, and developer oversight challenges in code generated by language models. Ranked #582Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Analyzes benchmark contamination and evaluation metrics for code generation models. | |
| Towards a Benchmark for Fire Safety Code Interpretation in the Hong Kong AEC Industry This paper evaluates proprietary and open-source language models on Hong Kong fire safety code compliance using expert-curated questions. Ranked #583Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Introduces a benchmark evaluating LLM performance on regional AEC regulatory codes. | |
| An Explainable System for Offensive Content Detection in Nastaliq Urdu: Corpus Curation, Transformer Benchmarking, and Word-Level Attribution The paper presents a Nastaliq Urdu comment corpus and evaluates transformer models with word-level attributions for offensive content detection. Ranked #584Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Curates a new benchmark dataset and evaluates transformer models on Nastaliq Urdu. | |
| bharatSetu: a 1M x 22 bridge for indic translation The paper introduces a synthetic parallel translation dataset covering 22 scheduled Indic languages aligned via English pivot sentences. Ranked #585Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 06:17 | On-topic Releases a 22-language Indic translation dataset along with an evaluation protocol. | |
| Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models Surveys dataset design, construction methods, and evaluation protocols for improving spatial reasoning in multimodal language models. Ranked #586Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Analyzes spatial reasoning evaluation methodologies, scoring metrics, and benchmark types across multimodal models. | |
| Evaluating Large Language Models for Multilingual Abstractive Summarization: A Comprehensive Study of English and Bengali Evaluates closed and open models on English and Bengali abstractive summarization using lexical metrics, factuality checks, and automated judges. Ranked #587Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 15 Oct, 15:06 | On-topic Establishes a standardized multilingual benchmark and evaluates cross-lingual assessment metrics and LLM judges. | |
| ESG-Kor: A Korean Dataset for ESG-related Information Extraction and Practical Use Cases The paper presents a Korean dataset extracted from corporate sustainability reports to support information extraction on environmental, social, and governance topics. Ranked #588Peer-reviewed0/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents a new benchmark dataset for evaluating language models on ESG information extraction. | |
| Name-Bias in Large Language Models Measures demographic bias related to age, gender, and race based on first names across local language models. Ranked #589Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Presents an evaluation methodology and dataset for measuring demographic name-bias in LLMs. | |
| Data Strategies for Large Language Models: A Unified Perspective on the Training Lifecycle Reviews and formalizes data selection, weighting, and scheduling policies across the pretraining and post-training lifecycle of language models. Ranked #590Preprint0/10 suggested | LLM evaluation and benchmarks via arxiv · 17 Oct, 06:17 | On-topic Surveys inconsistent evaluation protocols and utility metrics for data selection. | |
| Judge Reliability Harness: Stress Testing the Reliability of LLM Judges The paper introduces an open-source library to construct validation suites that stress test the reliability of LLM judges. Ranked #591New testPreprint8/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via blog · 12 Oct, 16:38 | On-topic Introduces an open-source library to benchmark and stress-test the reliability of LLM-as-a-judge scoring. | |
| Reliability without Validity: A Systematic, Large-Scale Evaluation of LLM-as-a-Judge Models Across Agreement, Consistency, and Bias The paper evaluates twenty-one language models used as judges across three benchmarks, finding widespread discrepancies between agreement metrics and underlying validity. Ranked #592Surprising resultPreprint8/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via blog · 16 Oct, 06:19 | On-topic Studies the validity, consistency, and metrics of LLM-as-a-judge evaluation benchmarks. | |
| MADBench: Benchmarking the Security of Multi-Agent Debate This paper presents a benchmark to evaluate how adversarial attacks affect reasoning security in multi-agent debate systems. Ranked #593New testPreprint8/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via blog · 12 Oct, 18:09 | On-topic Introduces MADBench to evaluate security across multi-agent debate tasks. | |
| CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs The authors introduce CharXiv, a benchmark of realistic scientific charts designed to test descriptive and reasoning capabilities in multimodal language models. Ranked #594New testPreprint7/10 suggestedOlder paper (2024) Older paper (2024) — discussed this week | LLM evaluation and benchmarks via blog · 15 Oct, 15:11 | On-topic Presents a new benchmark and evaluation suite for multimodal chart reasoning. | |
| CPEMatch: A Controlled Benchmark for LLM Reasoning Over CPE/purl Vulnerability-Identifier Applicability The paper introduces a controlled benchmark evaluating how accurately LLMs determine whether software components match vulnerability advisory criteria. Ranked #595New testPeer-reviewed7/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via ieee · 12 Oct, 16:30 | On-topic Introduces a controlled benchmark to evaluate LLM reasoning over vulnerability identifiers. | |
| When Knowledge Changes: Metamorphic Testing of RAG Systems with Mutations The paper proposes a metamorphic testing method with mutation operators to evaluate how retrieval-augmented generation systems handle changing document corpora. Ranked #596New testPeer-reviewed7/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via acm · 16 Oct, 06:18 | On-topic Introduces a metamorphic testing benchmark and framework for evaluating RAG systems under corpus changes. | |
| Thoth: Mid-Training Bridges LLMs to Time Series Understanding This paper presents a mid-training method, corpus, and benchmark to help language models understand and reason about time series data. Ranked #597New testPreprint6/10 suggestedOlder paper (2026) Older paper (2026) — discussed this week | LLM evaluation and benchmarks via openreview · 14 Oct, 06:18 | On-topic Proposes KnoTS, a novel benchmark evaluating knowledge-intensive time-series reasoning. | |
| Video-Bench: Human-Aligned Video Generation Benchmark This paper introduces an evaluation benchmark using multimodal models to assess generated videos across human preference dimensions. Ranked #598New testPeer-reviewed6/10 suggestedOlder paper (2025) Older paper (2025) — discussed this week | LLM evaluation and benchmarks via ieee · 15 Oct, 06:19 | On-topic Introduces a new benchmark and multimodal evaluation framework for video generation models. | |
| Swedish Medical LLM Benchmark: development and evaluation of a framework for assessing large language models in the Swedish medical domain The paper introduces an evaluation benchmark comprising four clinical datasets to assess large language model performance in the Swedish medical domain. Ranked #599New testPeer-reviewed4/10 suggestedOlder paper (2025) Older paper (2025) — discussed this week | LLM evaluation and benchmarks via blog · 16 Oct, 06:19 | On-topic Introduces a new clinical evaluation benchmark dataset assessing LLMs in the Swedish medical domain. | |
| Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation The paper introduces a zero-shot LLM pipeline to generate counterfactual examples for stress-testing NLP models. Ranked #600Peer-reviewed0/10 suggestedOlder paper (2024) Older paper (2024) — discussed this week | LLM evaluation and benchmarks via ieee · 12 Oct, 16:30 | On-topic Presents a method to stress-test and evaluate NLP models using LLM-generated counterfactuals. |
541–600 of 3,345← PreviousNext →