Hugging Face's logo
Nathan Habib's picture
159 28 52

Nathan Habib PRO

SaylorTwift
codedevil111's profile picture varuy322's profile picture evijit's profile picture
·

AI & ML interests

None yet

Organizations

Hugging Face's profile picture Evaluation datasets's profile picture Hugging Test Lab's profile picture HuggingFaceGECLM's profile picture BigCode's profile picture Hugging Face H4's profile picture BigCode Data's profile picture Hugging Face Smol Cluster's profile picture Open LLM Leaderboard's profile picture huggingPartyParis's profile picture Qwen's profile picture gg-hf's profile picture Nanotron Research's profile picture HuggingFaceFW's profile picture HF-contamination-detection's profile picture Top Contributors: Dataset Downloads's profile picture hsramall's profile picture La Leaderboard's profile picture gg-tt's profile picture HuggingFaceEval's profile picture Novel Challenge's profile picture LLHF's profile picture SLLHF's profile picture lbhf's profile picture Lighteval testing org's profile picture Coordination Nationale pour l'IA's profile picture open-llm-leaderboard-react's profile picture Prompt Leaderboard's profile picture wut?'s profile picture Your Bench's profile picture Open R1's profile picture gg-hf-g's profile picture OpenEvals's profile picture arc-agi-community's profile picture

SaylorTwift's activity

New activity in arc-agi-community/arc-agi-2 19 days ago

Update README.md
#2 opened 20 days ago by
andreabip
New activity in open-llm-leaderboard/open_llm_leaderboard 4 months ago

Llama-3.1 70B Math Hard doesn't match its dataset

3
#1041 opened 4 months ago by
MaziyarPanahi
New activity in open-llm-leaderboard/open_llm_leaderboard 11 months ago

bump-transformers-to-4.41.1

2
#753 opened 11 months ago by
alozowski

apply-ruff

7
#748 opened 11 months ago by
alozowski
New activity in open-llm-leaderboard/GenerationVisualizer 11 months ago

bbh_math_fixes

1
#1 opened 11 months ago by
alozowski
New activity in open-llm-leaderboard/open_llm_leaderboard 11 months ago

Understanding raw result data files

1
4
#729 opened 12 months ago by
jerome-white

No good way to identify number of activated parameters causes MIxtral evaluation failures

1
32
#680 opened about 1 year ago by
0-hero
New activity in open-llm-leaderboard/open_llm_leaderboard 12 months ago

GSM8K failure with Llama 3 finetunes

12
#703 opened 12 months ago by
jeiku
New activity in open-llm-leaderboard-old/results about 1 year ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#57 opened about 1 year ago by
SaylorTwift
New activity in open-llm-leaderboard-old/requests about 1 year ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#102 opened about 1 year ago by
SaylorTwift
New activity in open-llm-leaderboard/open_llm_leaderboard about 1 year ago

Model evaluation failed after 2 days

17
#622 opened about 1 year ago by
migtissera

bigstral and bigyi both failed

1
#628 opened about 1 year ago by
ehartford
New activity in open-llm-leaderboard-old/results about 1 year ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

2
#46 opened about 1 year ago by
SaylorTwift

Renaming Model gg-hf/gemma-7b to google/gemma-7b

2
#45 opened about 1 year ago by
SaylorTwift
New activity in google/gemma-7b about 1 year ago

Fix typo
#15 opened about 1 year ago by
SaylorTwift
New activity in open-llm-leaderboard-old/details_google__gemma-2b about 1 year ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b
#1 opened about 1 year ago by
SaylorTwift
New activity in open-llm-leaderboard-old/details_google__gemma-7b about 1 year ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b
#1 opened about 1 year ago by
SaylorTwift
New activity in open-llm-leaderboard/open_llm_leaderboard about 1 year ago

Model not found on hub

4
#584 opened about 1 year ago by
akshay326

152334H/miqu-1-70b-sf marked as private or deleted

3
#587 opened about 1 year ago by
TNTOutburst

Model submission

1
#590 opened about 1 year ago by
axra