TheBloke
/

openchat-3.5-0106-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Example of streaming hugging face transformers inference

#3 opened over 1 year ago by

config.json "eos_token_id" was wrong !!!

#1 opened over 1 year ago by