Solution if access to llama gets rejected

#86
by junAiStrata - opened

if your access to llama-3.2 gets rejected, do not worry. Just replace the llama-3.2 with the publicly available llama-3.2 endpoint as described in the notebook.

client = InferenceClient("https://jc26mwg228mkj8dw.us-east-1.aws.endpoints.huggingface.cloud")

if the outputs for next cells are wrong, the free model may be overloaded. You can also use this public endpoint that contains Llama-3.2-3B-Instruct

#client = InferenceClient("https://jc26mwg228mkj8dw.us-east-1.aws.endpoints.huggingface.cloud")

When I make the change the error occurs:
BadRequestError: (Request ID: SFcDKo)

Bad request:
Bad Request: Invalid state

I get 503 error with the default InferenceClient and 400 error when running the alternative InferenceClient

Skärmklipp.PNG

image.png

Sign up or log in to comment