Hugging Face's logo

lewiswatson
/
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged-GGUF

Transformers
GGUF
conversational
Model card Files Community
lewiswatson commited on
Commit
90e2227
·
verified ·
1 Parent(s): 7aa6100

Upload GGUF quantised models

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf +3 -0
  3. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf +3 -0
  4. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf +3 -0
  5. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf +3 -0
  6. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf +3 -0
  7. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf +3 -0
  8. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf +3 -0
  9. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf +3 -0
  10. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf +3 -0
  11. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf +3 -0
  12. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf +3 -0
  13. Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.f16.gguf +3 -0
  14. README.md +37 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.f16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8b937727ab628e5f132df163dc54889873ba402d0c7bb0b4e2aaf06753f5d77
3
+ size 4250298400
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec2ff977a60be8eaf270587d2fd923cf3665df354330708bcc2805921925f945
3
+ size 3015940128
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b7ce0bc88c70901458f586e673ab27231dbf439cdaf53e2544d64219bafca48
3
+ size 4088459296
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1a3f1280e434417011ea22e5c790e1fc6d003d8be1359086b64ab1740cf6aaf
3
+ size 3808391200
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:320e3089fc930f1b63372e2a4ae657f714b160d11205a1c5e13f73947a558f1e
3
+ size 3492368416
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af4d33095b3e9200b9d731bd4bbfb8ef5828aece47ac12791173ababd96d47bd
3
+ size 4683073568
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76b304f63873498bb89e77d3925e866661efcdf48c6a4bfeddc0c123f646ecd4
3
+ size 4457768992
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:030b16be176353960ffbe783ff875910deb22206bc1453b6638c1dd580628664
3
+ size 5444831264
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dad9c61bde87c38e60642b0a64377da298dde803bb00f1df168e84c0490373a
3
+ size 5315176480
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e593720055c42f919f1fbce6cd5aca8145f15dc2d0c00222ec27df6237f6508
3
+ size 6254198816
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e84bed4f943837cbbce5bcb637e1df3b32f093452a9128dec16575f38299b932
3
+ size 8098525216
Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bee7911d295b36b26b97d5dc55bc14970f5adb5dc8dce32821d45059cf47bf34
3
+ size 15237853216
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: transformers
4
+ tags:
5
+ - gguf
6
+ base_model: lewiswatson/Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged-GGUF
7
+ ---
8
+
9
+ # GGUF Quantised Models for Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged
10
+
11
+ This repository contains GGUF format model files for `lewiswatson/Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged-GGUF`, quantised.
12
+
13
+ ## Original Model
14
+
15
+ The original fine-tuned model used to generate these quantisations can be found here:
16
+ [lewiswatson/Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged-GGUF](https://huggingface.co/lewiswatson/Qwen2.5_7B_Instruct_Johnny_Silverhand_Merged-GGUF)
17
+
18
+ ## Provided Files (GGUF)
19
+
20
+ | File | Size |
21
+ |----------------------------|------|
22
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf` | 3.96 GB |
23
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf` | 2.81 GB |
24
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf` | 3.81 GB |
25
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf` | 3.55 GB |
26
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf` | 3.25 GB |
27
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf` | 4.36 GB |
28
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf` | 4.15 GB |
29
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf` | 5.07 GB |
30
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf` | 4.95 GB |
31
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf` | 5.82 GB |
32
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf` | 7.54 GB |
33
+ | `Qwen2.5-7B-Instruct_Johnny_Silverhand_Merged.f16.gguf` | 14.19 GB |
34
+
35
+
36
+ ---
37
+ *This repository was automatically created using a script on 2025-04-14.*