Hugging Face's logo

macrae
/
Llama-3-2-3B-rk3588

llama3.2
llama3.2-3B
rkllm
rockchip
rk3588
Model card Files Community
1
macrae commited on
Commit
6d617da
·
verified ·
1 Parent(s): c5747c6

Update README.md

Browse files

add shortcut to bracnh of the models

Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -12,7 +12,10 @@ tags:
12
  This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices.
13
  Target conversion to be running on the RK3588 NPU.
14
 
15
- Converted with **RKLLM runtime 1.1.1**
 
 
 
16
  # License
17
  Same as the original LLM:
18
 
 
12
  This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices.
13
  Target conversion to be running on the RK3588 NPU.
14
 
15
+ Model converted with **RKLLM runtime 1.1.1**, please follow this quantification to access the model:
16
+ - [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.1)
17
+ - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8_g512-toolkitv1.1.1)
18
+
19
  # License
20
  Same as the original LLM:
21