ddobokki's picture
Update model metadata to set pipeline tag to the new `text-ranking` and library name to `sentence-transformers` (#2)
e7e16e5 verified
metadata
language:
  - ko
tags:
  - sentence_transformers
  - cross_encoder
pipeline_tag: text-ranking
library_name: sentence-transformers

Example

from sentence_transformers import CrossEncoder

model = CrossEncoder('ddobokki/electra-small-sts-cross-encoder')
model.predict(["๊ทธ๋…€๋Š” ํ–‰๋ณตํ•ด์„œ ์›ƒ์—ˆ๋‹ค.", "๊ทธ๋…€๋Š” ์›ƒ๊ฒจ์„œ ๋ˆˆ๋ฌผ์ด ๋‚ฌ๋‹ค."])
-> 0.8206561

Dataset

  • KorSTS
    • Train
    • Test
  • KLUE STS
    • Train
    • Test

Performance

Dataset Pearson corr. Spearman corr.
KorSTS(test) + KLUE STS(test) 0.8528 0.8504

TODO

Using KLUE 1.1 train, dev data