Update README.md
Browse files
README.md
CHANGED
@@ -38,12 +38,12 @@ Benchmark
|
|
38 |
|
39 |
This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
|
40 |
|
41 |
-
| **model** | **PER**
|
42 |
-
| :---------------------------------------------------------------------------------------------------------------: |
|
43 |
-
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | 93.91
|
44 |
-
| [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 95.20
|
45 |
-
| [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 79.93
|
46 |
-
| [flair/ner-french](https://huggingface.co/flair/ner-french) | 80.18
|
47 |
|
48 |
How to use DistilCamemBERT-NER
|
49 |
------------------------------
|
|
|
38 |
|
39 |
This model performance is compared to 3 reference models (see below) with the metric [MCC (Matthews Correlation Coefficient)](https://en.wikipedia.org/wiki/Phi_coefficient). The score is given with a factor x100 and the delta gain with DistilCamemBERT-NER used in reference is in parantheses. For the inference time measure, an AMD Ryzen 5 4500U @ 2.3GHz with 6 cores was used:
|
40 |
|
41 |
+
| **model** | **PER** | **LOC** | **ORG** | **MISC** | **O** | **time** |
|
42 |
+
| :---------------------------------------------------------------------------------------------------------------: | :--------------: | :--------------: | :--------------: | :--------------: | :------------- : | :----------------: |
|
43 |
+
| [cmarkea/distilcamembert-base-ner](https://huggingface.co/cmarkea/distilcamembert-base-ner) | 93.91 | 88.26 | 84.03 | 82.74 | 91.45 | 43.44 |
|
44 |
+
| [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) | 95.20<br/>(+1%) | 90.85<br/>(+3%) | 89.50<br/>(+6%) | 89.02<br/>(+8%) | 92.86<br/>(+2%) | 83.70<br/>(+93%) |
|
45 |
+
| [Davlan/bert-base-multilingual-cased-ner-hrl](https://huggingface.co/Davlan/bert-base-multilingual-cased-ner-hrl) | 79.93<br/>(-15%) | 70.39<br/>(-22%) | 60.26<br/>(-28%) | NA | 69.95<br/>(-24%) | 87.56<br/>(+102%) |
|
46 |
+
| [flair/ner-french](https://huggingface.co/flair/ner-french) | 80.18<br/>(-15%) | 72.11<br/>(-18%) | 67.29<br/>(-20%) | 72.39<br/>(-17%) | 74.34<br/>(-19%) | 314.96<br/>(+625%) |
|
47 |
|
48 |
How to use DistilCamemBERT-NER
|
49 |
------------------------------
|