What Matters in Transformers? Not All Attention is Needed
Paper
•
2406.15786
•
Published
•
32
•
3
Eni Grand
Enigrand
b082f689-ebc3-413d-b1f2-27bd1e86dca7's profile picture
fibrosis's profile picture
shtefcs's profile picture
·
AI & ML interests
None yet
Recent Activity
liked
a model
2 days ago
Skywork/SkyReels-V2-DF-14B-720P
liked
a model
3 days ago
Skywork/Skywork-R1V2-38B
liked
a model
3 days ago
google/siglip2-so400m-patch16-naflex
Organizations
Enigrand's activity
It's been a wild ride, folks :) (end of the Open LLM Leaderboard)
82
20
#1135 opened about 1 month ago
by
clefourrier
Qwen2.5-32B merge eval error
3
5
#1078 opened 3 months ago
by
ehristoforu
commented
a
paper
6 months ago
If you find Independent third-party evaluation results about this model, please share here.
1
7
#42 opened 8 months ago
by
Enigrand
Hi, can you deal with the bot spamming the community section of mattshumer/ref_70_e3 and
6
#16 opened 8 months ago
by
Enigrand
🚩 Report
3
17
#6 opened 8 months ago
by
gileneo
Reflection-Llama-3.1-70B was sonnet 3.5.
6
#5 opened 8 months ago
by
Enigrand
mattshumer/ref_70_e3 and mattshumer/Reflection-Llama-3.1-70B-ep2-working are the SAME.
4
2
#10 opened 8 months ago
by
Enigrand
Third party evaluation on this so-called "LLM".
3
#7 opened 8 months ago
by
Enigrand
Reflection-Llama-3.1-70B was claude 3, chatgpt4o and what?
7
1
#48 opened 8 months ago
by
Enigrand
[Question] 2B or 5B?
2
#1 opened 8 months ago
by
Enigrand
[MODELS] Discussion
34
731
#372 opened about 1 year ago
by
victor
How to FP8 inference
5
2
#5 opened 9 months ago
by
alfredplpl
Questions about the context length
2
#4 opened 11 months ago
by
Enigrand