Auto86%Harbor: pendingKnowledge & ReasoningMathInstruction FollowingMultilingual

KBS

Korean Benchmark Suite

A suite of 9,396 Korean items across six capabilities (science, math, sentiment, reasoning, context, instruction) evaluating foundation models.

How to run

ltb · kbs
$ npm i -g lettokenburn-cli
$ ltb bench info kbs

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

4 sourced entries
HarnessSourceConfidenceLink
GPT-5.596.3N/AIndependentmediumOct 15, 2026arxiv.org
Claude Opus 4.796.1N/AIndependentmediumOct 15, 2026arxiv.org
GPT-5-mini94.5N/AIndependentmediumOct 15, 2026arxiv.org
Claude Haiku 4.593.5N/AIndependentmediumOct 15, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

KBS comprises Ko-ARC, Ko-GSM8K, Ko-EQ-Bench, Ko-WinoGrande, Ko-LAMBADA, and Ko-IFEval. It uses review, localization, and direct construction to avoid translation-only artifacts.

It evaluates Korean, multilingual, and closed models using protocols accounting for prompt format and scoring. Findings highlight dependence on task construction and suggest reporting both scores and settings.