freshstack/corpus-oct-2024
Viewer
•
Updated
•
272k
•
88
•
3
FreshStack
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
freshstack's activity
nthakur
updated
2
datasets
1 day ago
Update task category to question-answering and add paper link
2
#2 opened 3 days ago
by
nielsr
Update task category to `question-answering`
1
#2 opened 3 days ago
by
nielsr
Update task category to question-answering and add paper link
2
#2 opened 3 days ago
by
nielsr
nthakur
published
2
datasets
4 days ago
Post
1574
Last year, I curated & generated a few multilingual SFT and DPO datasets by translating English SFT/DPO datasets into 9-10 languages using the
mistralai/Mistral-7B-Instruct-v0.2 model.
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
nthakur
authored
a
paper
about 2 months ago
okhattab
authored
a
paper
5 months ago
nthakur
authored
a
paper
5 months ago
nthakur
authored
a
paper
8 months ago
mrdrozdov
authored
a
paper
9 months ago
Post
3471
🦢 The SWIM-IR dataset contains 29 million text-retrieval training pairs across 27 diverse languages. It is one of the largest synthetic multilingual datasets generated using PaLM 2 on Wikipedia! 🔥🔥
SWIM-IR dataset contains three subsets :
- Cross-lingual:
- Monolingual:
- Indic Cross-lingual:
Check it out:
https://huggingface.co/collections/nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7
SWIM-IR dataset contains three subsets :
- Cross-lingual:
nthakur/swim-ir-cross-lingual- Monolingual:
nthakur/swim-ir-monolingual- Indic Cross-lingual:
nthakur/indic-swim-ir-cross-lingualCheck it out:
https://huggingface.co/collections/nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7
mrdrozdov
authored
2
papers
about 1 year ago
okhattab
authored
2
papers
about 1 year ago