Add Guidance for Repetition Penalty

#2
IBM Granite org

https://github.com/huggingface/transformers/pull/37625 added support for excluding the input tokens from RepetitionPenaltyLogitsProcessor - this updates the code snippet to do this with a repetition penalty of 3.

Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment