Script request

by singhsidhukuldeep - opened Jul 26, 2024

Jul 26, 2024

Hello @TechxGenus
Thanks for the quantisation 🙂
Can you please share the script that you used to do it?
And if possible the hardware configuration?!

Also have you calculated the perplexity?

Owner Jul 27, 2024

I use the default script of AutoAWQ, with 2 RTX 4090.
PPL: 2.892

Jul 27, 2024

Hey @TechxGenus
Thanks for the info.

Is this your local setup OR are you using any cloud provider?

Owner Jul 27, 2024

Is my local setup.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment