Auto86%Harbor: pendingKnowledge & Reasoning

EMG-FM-Bench

EMG-FM-Bench: A Comprehensive Benchmark for Foundation Model Transfer and Adaptation on Electromyography

Evaluates 9 foundation models on 20 public EMG datasets (>1M segments) for transfer, adaptation, generalization, and task consistency.

How to run

ltb · emg-fm-bench
$ npm i -g lettokenburn-cli
$ ltb bench info emg-fm-bench

External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.

Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs

Scores

10 sourced entries
HarnessSourceConfidenceLink
Chronos-2-B32.1N/AIndependentmediumOct 5, 2026arxiv.org
TimesFM30.6N/AIndependentmediumOct 5, 2026arxiv.org
Chronos-2-S30.2N/AIndependentmediumOct 5, 2026arxiv.org
MOMENT-S28.5N/AIndependentmediumOct 5, 2026arxiv.org
MOMENT-B27.9N/AIndependentmediumOct 5, 2026arxiv.org
UniTS23.5N/AIndependentmediumOct 5, 2026arxiv.org
Lag-Llama23.3N/AIndependentmediumOct 5, 2026arxiv.org
BiLSTM17.5N/AIndependentmediumOct 5, 2026arxiv.org
BRANT16.3N/AIndependentmediumOct 5, 2026arxiv.org
PatchTST13.4N/AIndependentmediumOct 5, 2026arxiv.org

Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.

Reproduced by the community

All runs
Loading community runs…

About

Unifies 20 public EMG datasets with over 1 million segments to evaluate nine pretrained foundation models. It assesses linear probing vs. fine-tuning, pretraining benefits, cross-user generalization, and task consistency.

Scoring uses macro-F1 across classification and decoding tasks. Findings show full fine-tuning significantly alters performance, pretraining benefits are not universal, and cross-user generalization remains challenging despite five-shot adaptation.