which provider do you use?
We'll ship a provider="auto" in the coming days BTW, cc
@sbrandeis
@Wauplin
@celinah
In the meantime, the model is served by those providers, you can use one of them, for instance, add provider="novita" to your code:
Hey, things have been in flux somewhat, but they should stabilize now. Sorry about the moving parts!
More details, from @michellehbn :
In February, Inference billing usage had been a fixed rate while we added pay-as-you-go support so now, usage in March on takes into account compute time x price of the hardware. We're really sorry for any confusion or scare! We have more information about Inference Providers here: https://huggingface.co/docs/inference-providers/en/index
it's definitely the future:)
Also, If I disable the other Inference API's It wont be used? So I wont get billed?
that's correct
Weโll fix it
pip install kokoro, and still 82M parameters.
works for orgs too!
yes
@DouglasMourray
imo the Local apps menu should solve part of what you're looking for:
https://www.reddit.com/r/LocalLLaMA/comments/1cwjc4n/hugging_face_adds_an_option_to_directly_launch/
Keen on hearing more feedback!