Minh141120 commited on
Commit
a826783
·
verified ·
1 Parent(s): e879326

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-generation
4
+ tags:
5
+ - cortexp.cpp
6
+ - featured
7
+ ---
8
+
9
+ ## Overview
10
+
11
+ **Qwen Team** developed and released the **Qwen3** series, a state-of-the-art family of language models optimized for advanced reasoning, dialogue, instruction-following, and agentic use cases. Qwen3 introduces innovative thinking/non-thinking mode switching, long context capabilities, and multilingual support, all while achieving high efficiency and performance.
12
+
13
+ The Qwen3 models span several sizes and include support for seamless reasoning, complex tool usage, and detailed multi-turn conversations, making them ideal for applications such as research assistants, code generation, enterprise chatbots, and more.
14
+
15
+ ## Variants
16
+
17
+ ### Qwen3
18
+
19
+ | No | Variant | Branch | Cortex CLI command |
20
+ |----|--------------------------------------------------------------------------------------------|--------|-------------------------------|
21
+ | 1 | [Qwen3-4B](https://huggingface.co/cortexso/qwen3/tree/4b) | 4b | `cortex run qwen3:4b` |
22
+ | 2 | [Qwen3-8B](https://huggingface.co/cortexso/qwen3/tree/8b) | 8b | `cortex run qwen3:8b` |
23
+ | 3 | [Qwen3-32B](https://huggingface.co/cortexso/qwen3/tree/32b) | 32b | `cortex run qwen3:32b` |
24
+ | 4 | [Qwen3-30B-A3B](https://huggingface.co/cortexso/qwen3/tree/30b-a3b) | 30b-a3b| `cortex run qwen3:30b-a3b` |
25
+
26
+ Each branch contains multiple quantized GGUF versions:
27
+ - **Qwen3-4B:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0
28
+ - **Qwen3-8B:** q2_k, q3_k_l, q3_k_m, q3_k_s, q4_k_m, q4_k_s, q5_k_m, q5_k_s, q6_k, q8_0
29
+ - **Qwen3-32B:** *coming soon*
30
+ - **Qwen3-30B-A3B:** *coming soon*
31
+
32
+ ## Use it with Jan (UI)
33
+
34
+ 1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
35
+ 2. Use in Jan model Hub:
36
+ ```bash
37
+ cortexso/qwen3
38
+ ```
39
+
40
+ ## Use it with Cortex (CLI)
41
+
42
+ 1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
43
+ 2. Run the model with command:
44
+ ```bash
45
+ cortex run qwen3
46
+ ```
47
+
48
+ ## Credits
49
+
50
+ - **Author:** Qwen Team
51
+ - **Converter:** [Menlo Research](https://menlo.ai/)
52
+ - **Original License:** [License](https://www.apache.org/licenses/LICENSE-2.0)
53
+ - **Blogs:** [Qwen3: Think Deeper, Act Faster](https://qwenlm.github.io/blog/qwen3/)