GraphMAS
GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning
LLM-based multi-agent systems coordinate specialized reasoning through aggregation, interaction, and adaptive control, yet their potential for graph learning remains unexplored.
How to run
$ npm i -g lettokenburn-cli$ ltb bench info graphmas
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
Scores
14 sourced entries| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| Adaptive Routing | 71.2 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Graph of Agents | 71.2 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| GraphSearch | 69.8 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| LLM Aggregation | 69.3 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| DyLAN | 69.0 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Multi-Agent Debate | 69.0 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| SOP Workflow | 67.8 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Global Relevance | 67.4 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Proximal Neighborhood | 67.4 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Semantic Affinity | 65.9 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Search-o1 | 65.4 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Chain-of-Thought | 63.9 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Distal Neighborhood | 63.5 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
| Graph-CoT | 60.7 | N/A | Independent | medium | Sep 30, 2026 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
Reproduced by the community
All runsAbout
LLM-based multi-agent systems coordinate specialized reasoning through aggregation, interaction, and adaptive control, yet their potential for graph learning remains unexplored. Graph learning is a natural setting for such systems because useful evidence may arise from heterogeneous local, long-range, global structural, and semantic perspectives whose relevance varies across instances. Existing LLM-based graph learning approaches primarily rely on single-agent reasoning, while multi-agent coordination has been studied mainly in general reasoning settings. Consequently, it remains unclear whether multiple specialized agents can improve graph learning and how coordination strategies should be designed and evaluated. To address this gap, we introduce GraphMAS, a systematic benchmark of multi-agent coordination for graph learning. GraphMAS builds a shared pool of graph reasoning specialists and organizes coordination along two dimensions, inter-agent interaction and runtime adaptivity, yielding four paradigms and seven representative coordination methods. Under a unified protocol, we evaluate these methods across seven text-attributed graphs, three domains, and two graph learning tasks. We find that heterogeneous graph perspectives are complementary, and that coordinating specialists improves over individual specialists and single-agent graph reasoning, with gains from decomposing reasoning across specialists rather than from broader evidence access alone. However, richer inter-agent interaction does not reliably help, whereas instance-adaptive specialist selection yields the strongest accuracy-efficiency trade-off. We further show that coordination can be learned over a fixed specialist pool and transfers to held-out graphs. GraphMAS therefore provides a controlled evaluation framework and empirical principles for understanding when and how multi-agent coordination benefits graph learning.