Verified100%Harbor adapterSafety & AlignmentKnowledge & Reasoning

adv glue

Adversarial GLUE

adv glue — AI evaluation benchmark listed by opencompass.

How to run

ltb · adv-glue
$ npm i -g lettokenburn-cli
$ ltb bench pull adv-glue --n 50
$ ltb bench run ./adv-glue -a claude-code -m anthropic/claude-opus-4-8
$ ltb bench push

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

0 sourced entries

No sourced scores recorded yet.

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Adversarial GLUE (AdvGLUE) is a new multi-task benchmark to quantitatively and thoroughly explore and evaluate the vulnerabilities of modern large-scale language models under various types of adversarial attacks. In particular, we systematically apply 14 textual adversarial attack methods to [GLUE](/dataset/glue) tasks to construct AdvGLUE, which is further validated by humans for reliable annotations.

Description from: Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models