Parameters

by Fujiao - opened Mar 13

Mar 13

Hello,

Thanks for your great work! I am wondering how we can change the parameters, like temperature, top p, top k, etc. There is only do_sample=False. Thanks

aryan835-datainflexion

Mar 14

Hey @Fujiao , you can add the parameters when calling the 'model.generate()' function like this:

model.generate(**inputs, do_sample=False, max_new_tokens=100, temperature=0, top_p=0, top_k=0)

Hope that solves your question!

Fujiao

Mar 17

•

edited Mar 17

Thanks for your reply. It helps a lot. I did not think that it follows the same way :) @aryan835-datainflexion

lkv

Google org 3 days ago

Hi @Fujiao ,

Could you please confirm if issue is resolved feel free to close this issue . or if you have any concerns let us know will assist you.

Thank you.

Fujiao changed discussion status to closed 3 days ago

Fujiao changed discussion status to open 3 days ago

Fujiao

3 days ago

Yeah, it is resolved. Thanks

Fujiao changed discussion status to closed 3 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment