inference API
#19
by
opium80s
- opened
Once I FT this model, can HF host this inference api? I noticed HF doesn't support the 27b, just wondering if it can with 12b. Thanks.
Hi @opium80s ,
Yes, we can host fine-tuned model on Hugging Face and expose it via their Inference API. Could you please refer to below references.
Hugging Face Inference API Documentation
Hugging Face Inference Client Reference
Thank you.