tokyotech-llm
/

Llama-3.1-Swallow-70B-Instruct-v0.1

@@ -10,6 +10,7 @@ license:
 model_type: llama
 datasets:
   - lmsys/lmsys-chat-1m
   - argilla/magpie-ultra-v0.1
 ---
@@ -187,6 +188,7 @@ The following datasets were used for the instruction tuning.
   - `lmsys-chat-1m-synth-ja-wo-pii-and-template-instructions`
     - Single-turn Japanese instruction dataset synthesized and derived from [lmsys-chat-1m](https://huggingface.co/datasets/lmsys/lmsys-chat-1m) [\[Zhang+, ICLR24\]](https://openreview.net/forum?id=BOfDKxfwt0)). First-turn user instructions were translated into Japanese via DeepL (machine translation), and assistant responses were generated using [Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct). [Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct) served as a judge for rejection sampling (n=6).
    Conversations containing personally identifiable information (PII) and template-based user instructions were removed. Duplicate instructions were removed.
   - `filtered-magpie-ultra-ja`
     - A Japanese variant of the `filtered-magpie-ultra-en` dataset, translated into Japanese by [gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it).
   - `gemma-magpie`
@@ -194,6 +196,7 @@ The following datasets were used for the instruction tuning.
 - English
   - `lmsys-chat-1m-synth-en-wo-pii-and-template-instructions`
     - The creation process is similar to `lmsys-chat-1m-synth-ja-wo-pii-and-template-instructions`, but this version uses the original English user instructions. The assistant responses were generated in English as well. Rejection sampling was not applied for this version.
   - `filtered-magpie-ultra-en`
     - A subset of the [magpie-ultra](https://huggingface.co/datasets/argilla/magpie-ultra-v0.1) dataset, developed following the MAGPIE recipe [\[Xu+, arXiv24\]](https://arxiv.org/abs/2406.08464) using [Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct). This subset includes only samples rated as 'average,' 'good,' or 'excellent.'

 model_type: llama
 datasets:
   - lmsys/lmsys-chat-1m
+  - tokyotech-llm/lmsys-chat-1m-synth
   - argilla/magpie-ultra-v0.1
 ---
   - `lmsys-chat-1m-synth-ja-wo-pii-and-template-instructions`
     - Single-turn Japanese instruction dataset synthesized and derived from [lmsys-chat-1m](https://huggingface.co/datasets/lmsys/lmsys-chat-1m) [\[Zhang+, ICLR24\]](https://openreview.net/forum?id=BOfDKxfwt0)). First-turn user instructions were translated into Japanese via DeepL (machine translation), and assistant responses were generated using [Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct). [Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct) served as a judge for rejection sampling (n=6).
    Conversations containing personally identifiable information (PII) and template-based user instructions were removed. Duplicate instructions were removed.
+    - The dataset is available at [tokyotech-llm/lmsys-chat-1m-synth](https://huggingface.co/datasets/tokyotech-llm/lmsys-chat-1m-synth).
   - `filtered-magpie-ultra-ja`
     - A Japanese variant of the `filtered-magpie-ultra-en` dataset, translated into Japanese by [gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it).
   - `gemma-magpie`
 - English
   - `lmsys-chat-1m-synth-en-wo-pii-and-template-instructions`
     - The creation process is similar to `lmsys-chat-1m-synth-ja-wo-pii-and-template-instructions`, but this version uses the original English user instructions. The assistant responses were generated in English as well. Rejection sampling was not applied for this version.
+    - The dataset is available at [tokyotech-llm/lmsys-chat-1m-synth](https://huggingface.co/datasets/tokyotech-llm/lmsys-chat-1m-synth).
   - `filtered-magpie-ultra-en`
     - A subset of the [magpie-ultra](https://huggingface.co/datasets/argilla/magpie-ultra-v0.1) dataset, developed following the MAGPIE recipe [\[Xu+, arXiv24\]](https://arxiv.org/abs/2406.08464) using [Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct). This subset includes only samples rated as 'average,' 'good,' or 'excellent.'