Real-Time Video Generation with Pyramid Attention Broadcast
Paper
•
2408.12588
•
Published
•
17
Nils Fleischmann
nifleisch
AI & ML interests
Making generative models smaller, faster, and greener.
Recent Activity
upvoted
a
paper
9 days ago
Real-Time Video Generation with Pyramid Attention Broadcast
Organizations
nifleisch's activity
upvoted
a
paper
9 days ago
reacted to
davidberenstein1957's
post with 🤗🧠
18 days ago
Post
1701
🧑🏫 I wrote a brief blogpost to give An Introduction to AI Model Optimization Techniques!
URL: https://huggingface.co/blog/PrunaAI/introduction-to-ai-model-optimization-techniques
URL: https://huggingface.co/blog/PrunaAI/introduction-to-ai-model-optimization-techniques
liked
a
Space
25 days ago
liked
a
model
29 days ago
reacted to
sharpenb's
post with 🔥
about 2 months ago
Post
3102
We open-sourced the
- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
pruna package that can be easily installed with pip install pruna :) It allows to easily ccompress and evaluate AI models including transformers and diffusers.- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
- 2 replies
liked
a
model
about 2 months ago
updated
a
model
3 months ago
Upload folder using huggingface_hub
2
#2 opened 3 months ago
by
nifleisch
published
a
model
3 months ago
Upload folder using huggingface_hub
2
#1 opened 3 months ago
by
nifleisch
updated
a
model
3 months ago
Upload folder using huggingface_hub
2
#2 opened 3 months ago
by
nifleisch
published
a
model
3 months ago
Upload folder using huggingface_hub
2
#1 opened 3 months ago
by
nifleisch
reacted to
sharpenb's
post with 🔥
3 months ago
Post
1911
We compressed SmolLMs to make 135 variations of them (see
PrunaAI
) with different quantization configurations with
We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
PrunaAI
) with different quantization configurations with pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
- 3 replies