Hugging Face's logo

microsoft
/
Phi-4-mini-instruct

Text Generation
Transformers
Safetensors
phi3
nlp
code
conversational
custom_code
text-generation-inference
Model card Files Community
25

EOS BOS both <|endoftext|>?

#23
by mattjcly - opened
Discussion
mattjcly

https://huggingface.co/microsoft/Phi-4-mini-instruct/blob/main/tokenizer_config.json#L103-L106

I would imagine this is a bug?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment