TheBloke
/

Falcon-7B-Instruct-GPTQ

Text Generation

RefinedWebModel

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Falcon-7B-Instruct-GPTQ

Ctrl+K

Ctrl+K

3 contributors

History: 23 commits

TheBloke's picture

Update for Transformers GPTQ support

d6ce55f over 1 year ago

.gitattributes

1.48 kB

initial commit almost 2 years ago
README.md

16.8 kB

Update for Transformers GPTQ support over 1 year ago
config.json

955 Bytes

Update for Transformers GPTQ support over 1 year ago
configuration_RW.py

2.61 kB

Fix eos_token_id to align with vocabulary of this model (#6) almost 2 years ago
generation_config.json

111 Bytes

Initial AutoGPTQ model commit. almost 2 years ago
model.safetensors

5.94 GB
LFS

Update for Transformers GPTQ support over 1 year ago
modelling_RW.py

47.5 kB

Initial AutoGPTQ model commit. almost 2 years ago
quantize_config.json

157 Bytes

Update for Transformers GPTQ support over 1 year ago
special_tokens_map.json

281 Bytes

Initial AutoGPTQ model commit. almost 2 years ago
tokenizer.json

2.73 MB

Initial AutoGPTQ model commit. almost 2 years ago
tokenizer_config.json

220 Bytes

Initial AutoGPTQ model commit. almost 2 years ago