--- base_model: - fblgit/cybertron-v4-qw7B-UNAMGS - FuseAI/FuseChat-Qwen-2.5-7B-Instruct - ClaudioItaly/Intelligence-R1-Distill-7B - netcat420/DeepSeek-R1-Distill-Qwen-MFANN-Slerp-7b - bunnycore/Qwen-2.5-7B-Deep-Stock-v1 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [fblgit/cybertron-v4-qw7B-UNAMGS](https://huggingface.co/fblgit/cybertron-v4-qw7B-UNAMGS) as a base. ### Models Merged The following models were included in the merge: * [FuseAI/FuseChat-Qwen-2.5-7B-Instruct](https://huggingface.co/FuseAI/FuseChat-Qwen-2.5-7B-Instruct) * [ClaudioItaly/Intelligence-R1-Distill-7B](https://huggingface.co/ClaudioItaly/Intelligence-R1-Distill-7B) * [netcat420/DeepSeek-R1-Distill-Qwen-MFANN-Slerp-7b](https://huggingface.co/netcat420/DeepSeek-R1-Distill-Qwen-MFANN-Slerp-7b) * [bunnycore/Qwen-2.5-7B-Deep-Stock-v1](https://huggingface.co/bunnycore/Qwen-2.5-7B-Deep-Stock-v1) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: ClaudioItaly/Intelligence-R1-Distill-7B - model: netcat420/DeepSeek-R1-Distill-Qwen-MFANN-Slerp-7b - model: fblgit/cybertron-v4-qw7B-UNAMGS - model: FuseAI/FuseChat-Qwen-2.5-7B-Instruct - model: bunnycore/Qwen-2.5-7B-Deep-Stock-v1 merge_method: model_stock base_model: fblgit/cybertron-v4-qw7B-UNAMGS normalize: false int8_mask: true dtype: bfloat16 ```