LetTokenBurnWDC Products is an entity matching benchmark which provides for the systematic evaluation of matching systems along combinations of three dimensions while relying on real-word data.
$ npm i -g lettokenburn-cli$ ltb bench info wdc-products
External harness. No Harbor adapter has been generated for this benchmark yet. `ltb bench info` prints the known links.
Runs happen on your machine with your own subscription; only the score summary is pushed. CLI docs
| Harness | Source | Confidence | Link | |||
|---|---|---|---|---|---|---|
| GPT-4o 2024.08 06 Fine Tuned Wdc Small | 87.1 | N/A | Independent | medium | Sep 12, 2024 | arxiv.org |
Every number links to where it was published. Low-confidence rows are muted and need per-cell verification.
WDC Products is an entity matching benchmark which provides for the systematic evaluation of matching systems along combinations of three dimensions while relying on real-word data. The three dimensions are
i) amount of corner-cases
ii) generalization to unseen entities, and
iii) development set size
WDC Products contains 11715 product offers describing in total 2162 product entities belonging to various product categories.
Source: WDC Products: A Multi-Dimensional Entity Matching Benchmark