MapEval-API
Harbor adapterMapEval-Textual contains 300 question-answer pairs.
- Samples
- 300
- Released
- 2024
- Scores
- 0
MapEval-Textual contains 300 context-question-answer triplets.
$ npm i -g lettokenburn-cli$ ltb bench pull mapeval-textual --n 50$ ltb bench run ./mapeval-textual -a claude-code -m anthropic/claude-opus-4-8$ ltb bench push
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| Claude 3.5 Sonnet | 66.3 | N/A | Independent | medium | Dec 31, 2024 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
MapEval-Textual contains 300 context-question-answer triplets. The necessary geo-spatial information is provided in the context. The task is to answer question based on the factual data provided in the context.