Byte Latent Transformer: Patches Scale Better Than Tokens
Paper
•
2412.09871
•
Published
•
102
Architectural Proposals
-
-
Causal Diffusion Transformers for Generative Modeling
Paper • 2412.12095 • Published • 23 -
Tensor Product Attention Is All You Need
Paper • 2501.06425 • Published • 88 -
TransMLA: Multi-head Latent Attention Is All You Need
Paper • 2502.07864 • Published • 50 -
Transformers without Normalization
Paper • 2503.10622 • Published • 162 -
LSNet: See Large, Focus Small
Paper • 2503.23135 • Published • 9 -
DDT: Decoupled Diffusion Transformer
Paper • 2504.05741 • Published • 73 -
Latent Diffusion Autoencoders: Toward Efficient and Meaningful Unsupervised Representation Learning in Medical Imaging
Paper • 2504.08635 • Published • 5 -
D^2iT: Dynamic Diffusion Transformer for Accurate Image Generation
Paper • 2504.09454 • Published • 12 -
Efficient Generative Model Training via Embedded Representation Warmup
Paper • 2504.10188 • Published • 12 -
Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper • 2504.20966 • Published • 25 -
Group Downsampling with Equivariant Anti-aliasing
Paper • 2504.17258 • Published • 8