Auto43%Harbor: pendingAgentic / Tool Use

GraphMAS

GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning

LLM-based multi-agent systems coordinate specialized reasoning through aggregation, interaction, and adaptive control, yet their potential for graph learning remains unexplored.

How to run

ltb · graphmas
$ npm i -g lettokenburn-cli
$ ltb bench info graphmas

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

14 sourced entries
HarnessSourceConfidenceLink
Adaptive Routing71.2N/AIndependentmediumSep 30, 2026arxiv.org
Graph of Agents71.2N/AIndependentmediumSep 30, 2026arxiv.org
GraphSearch69.8N/AIndependentmediumSep 30, 2026arxiv.org
LLM Aggregation69.3N/AIndependentmediumSep 30, 2026arxiv.org
DyLAN69.0N/AIndependentmediumSep 30, 2026arxiv.org
Multi-Agent Debate69.0N/AIndependentmediumSep 30, 2026arxiv.org
SOP Workflow67.8N/AIndependentmediumSep 30, 2026arxiv.org
Global Relevance67.4N/AIndependentmediumSep 30, 2026arxiv.org
Proximal Neighborhood67.4N/AIndependentmediumSep 30, 2026arxiv.org
Semantic Affinity65.9N/AIndependentmediumSep 30, 2026arxiv.org
Search-o165.4N/AIndependentmediumSep 30, 2026arxiv.org
Chain-of-Thought63.9N/AIndependentmediumSep 30, 2026arxiv.org
Distal Neighborhood63.5N/AIndependentmediumSep 30, 2026arxiv.org
Graph-CoT60.7N/AIndependentmediumSep 30, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

LLM-based multi-agent systems coordinate specialized reasoning through aggregation, interaction, and adaptive control, yet their potential for graph learning remains unexplored. Graph learning is a natural setting for such systems because useful evidence may arise from heterogeneous local, long-range, global structural, and semantic perspectives whose relevance varies across instances. Existing LLM-based graph learning approaches primarily rely on single-agent reasoning, while multi-agent coordination has been studied mainly in general reasoning settings. Consequently, it remains unclear whether multiple specialized agents can improve graph learning and how coordination strategies should be designed and evaluated. To address this gap, we introduce GraphMAS, a systematic benchmark of multi-agent coordination for graph learning. GraphMAS builds a shared pool of graph reasoning specialists and organizes coordination along two dimensions, inter-agent interaction and runtime adaptivity, yielding four paradigms and seven representative coordination methods. Under a unified protocol, we evaluate these methods across seven text-attributed graphs, three domains, and two graph learning tasks. We find that heterogeneous graph perspectives are complementary, and that coordinating specialists improves over individual specialists and single-agent graph reasoning, with gains from decomposing reasoning across specialists rather than from broader evidence access alone. However, richer inter-agent interaction does not reliably help, whereas instance-adaptive specialist selection yields the strongest accuracy-efficiency trade-off. We further show that coordination can be learned over a fixed specialist pool and transfers to held-out graphs. GraphMAS therefore provides a controlled evaluation framework and empirical principles for understanding when and how multi-agent coordination benefits graph learning.