Article
Introducing HELMET
•
22
Régis Pierrard
regisss
AI & ML interests
None yet
Recent Activity
upvoted
an
article
12 days ago
Introducing HELMET
upvoted
an
article
about 1 month ago
Accelerating LLM Inference with TGI on Intel Gaudi
published
an
article
about 1 month ago
Accelerating LLM Inference with TGI on Intel Gaudi
Organizations
regisss's activity
upvoted
an
article
12 days ago
upvoted
an
article
about 1 month ago
Article
Accelerating LLM Inference with TGI on Intel Gaudi
By
and 4 others
•
•
13
published
an
article
about 1 month ago
Article
Accelerating LLM Inference with TGI on Intel Gaudi
By
and 4 others
•
•
13
updated
a
dataset
about 1 month ago
add-version-executorch
2
#34 opened about 2 months ago
by
echarlaix
liked
a
Space
2 months ago
posted
an
update
2 months ago
Post
1719
Nice paper comparing the fp8 inference efficiency of Nvidia H100 and Intel Gaudi2:
An Investigation of FP8 Across Accelerators for LLM Inference (2502.01070)
The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"
One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!
Gaudi3 results soon...
The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"
One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!
Gaudi3 results soon...
upvoted
a
paper
2 months ago
reacted to
fdaudens's
post with 🔥❤️
2 months ago
Post
2701
⭐️ The AI Energy Score project just launched - this is a game-changer for making informed decisions about AI deployment.
You can now see exactly how much energy your chosen model will consume, with a simple 5-star rating system. Think appliance energy labels, but for AI.
Looking at transcription models on the leaderboard is fascinating: choosing between whisper-tiny or whisper-large-v3 can make a 7x difference. Real-time data on these tradeoffs changes everything.
166 models already evaluated across 10 different tasks, from text generation to image classification. The whole thing is public and you can submit your own models to test.
Why this matters:
- Teams can pick efficient models that still get the job done
- Developers can optimize for energy use from day one
- Organizations can finally predict their AI environmental impact
If you're building with AI at any scale, definitely worth checking out.
👉 leaderboard: https://lnkd.in/esrSxetj
👉 blog post: https://lnkd.in/eFJvzHi8
Huge work led by @sasha with @bgamazay @yjernite @sarahooker @regisss @meg
You can now see exactly how much energy your chosen model will consume, with a simple 5-star rating system. Think appliance energy labels, but for AI.
Looking at transcription models on the leaderboard is fascinating: choosing between whisper-tiny or whisper-large-v3 can make a 7x difference. Real-time data on these tradeoffs changes everything.
166 models already evaluated across 10 different tasks, from text generation to image classification. The whole thing is public and you can submit your own models to test.
Why this matters:
- Teams can pick efficient models that still get the job done
- Developers can optimize for energy use from day one
- Organizations can finally predict their AI environmental impact
If you're building with AI at any scale, definitely worth checking out.
👉 leaderboard: https://lnkd.in/esrSxetj
👉 blog post: https://lnkd.in/eFJvzHi8
Huge work led by @sasha with @bgamazay @yjernite @sarahooker @regisss @meg
- 1 reply
Upload 2 files
3
#3 opened 3 months ago
by
zzhang37
Adding `safetensors` variant of this model
#2 opened 3 months ago
by
SFconvertbot
upvoted
an
article
3 months ago
Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
•
72
posted
an
update
4 months ago
Post
1030
Nice to see day 1 support of Falcon 3 on Gaudi with Optimum Habana!
👉 https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-falcon-3-fdn-models.html
👉 https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-falcon-3-fdn-models.html
Tradeoff energy bost / performance
3
2
#2 opened 4 months ago
by
cerisara
liked
a
Space
4 months ago
Upload 2 files
#2 opened 5 months ago
by
zzhang37
Expanding AI Energy Score Research to other GPUs
1
#1 opened 5 months ago
by
PranavViswanath
Upload 2 files
2
#1 opened 5 months ago
by
zzhang37