MERGEMS
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Model Stock merge method using TareksLab/Zhang-Heng-LLaMa-70B as a base.
Models Merged
The following models were included in the merge:
- Sao10K/L3.1-70B-Hanami-x1
- Mawdistical/Feral-Allura-70B
- Sao10K/L3-70B-Euryale-v2.1
- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Sao10K/L3.1-70B-Hanami-x1
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- model: Sao10K/L3-70B-Euryale-v2.1
- model: Mawdistical/Feral-Allura-70B
- model: TareksLab/Zhang-Heng-LLaMa-70B
base_model: TareksLab/Zhang-Heng-LLaMa-70B
merge_method: model_stock
parameters:
int8_mask: true
dtype: float32
out_dtype: bfloat16
chat_template: llama3
tokenizer:
source: union
pad_to_multiple_of: 8
- Downloads last month
- 24
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support