Distilling LLM Agent into Small Models with Retrieval and Code Tools
Paper
•
2505.17612
•
Published
•
71
Jeff Willette
jeffwillette
AI & ML interests
Self Supervised Learning
Permutation Invariant Neural Networks
Recent Activity
upvoted
a
paper
3 days ago
Distilling LLM Agent into Small Models with Retrieval and Code Tools
authored
a paper
9 days ago
SEA: Sparse Linear Attention with Estimated Attention Mask
authored
a paper
9 days ago
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased
Full Set Gradient Approximation
Organizations
None yet
jeffwillette's activity
upvoted
a
paper
3 days ago
authored
3
papers
9 days ago
SEA: Sparse Linear Attention with Estimated Attention Mask
Paper
•
2310.01777
•
Published
•
1
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation
Paper
•
2208.12401
•
Published
•
1
Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
Paper
•
2505.11254
•
Published
•
47
upvoted
3
papers
9 days ago
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation
Paper
•
2208.12401
•
Published
•
1
FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
Paper
•
2505.12805
•
Published
•
21
Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
Paper
•
2505.11254
•
Published
•
47