RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale
Paper
•
2505.03005
•
Published
•
23
Samuel Arcadinho
SSamDav
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 22 hours ago
RADLADS: Rapid Attention Distillation to Linear Attention Decoders at
Scale
upvoted
a
paper
9 days ago
Implicit Language Models are RNNs: Balancing Parallelization and
Expressivity
upvoted
a
paper
23 days ago
MIEB: Massive Image Embedding Benchmark
Organizations
SSamDav's activity
upvoted
a
paper
about 22 hours ago
upvoted
a
paper
9 days ago
upvoted
a
paper
23 days ago
upvoted
a
paper
27 days ago
upvoted
2
papers
29 days ago
upvoted
a
paper
about 1 month ago
upvoted
5
papers
about 2 months ago
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper
•
2503.14456
•
Published
•
147
Transformers without Normalization
Paper
•
2503.10622
•
Published
•
162
Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning
Paper
•
2503.07572
•
Published
•
44
Forgetting Transformer: Softmax Attention with a Forget Gate
Paper
•
2503.02130
•
Published
•
32
EuroBERT: Scaling Multilingual Encoders for European Languages
Paper
•
2503.05500
•
Published
•
78
upvoted
2
papers
2 months ago
upvoted
2
collections
3 months ago
upvoted
4
papers
3 months ago
Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
Paper
•
2502.05171
•
Published
•
140
Scalable-Softmax Is Superior for Attention
Paper
•
2501.19399
•
Published
•
22
s1: Simple test-time scaling
Paper
•
2501.19393
•
Published
•
120
DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
Paper
•
2411.04983
•
Published
•
13