4 1 5

Julien Delavande

jdelavande

https://delavande.fr

AI & ML interests

None yet

Recent Activity

liked a Space 1 day ago

smolagents/computer-agent

updated a Space 8 days ago

jdelavande/chat-ui-energy

upvoted an article 9 days ago

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

View all activity

Organizations

jdelavande's activity

liked a Space 1 day ago

237

Computer Agent

🖥

Control a virtual computer to complete tasks

updated a Space 8 days ago

Chat UI Energy Score

⚡

Interact with an AI chatbot tracking energy usage

upvoted an article 9 days ago

Article

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Jan 16

• 73

New activity in jdelavande/chat-ui-energy 14 days ago

Energy Calculation for more models

#6 opened 16 days ago by

Sarvesh19

replied to clem's post 16 days ago

curl https://jdelavande-dev-tgi.hf.space/
-X POST
-H "Content-Type: application/json"
-d '{"inputs":"Hello how are you ?", "parameters":{"max_new_tokens":20}}'

Should work, it directly calls the inference server where the Qwen 2.5 7B is hosted. We might work on integrating the data in the standard api of TGI in the future!

New activity in jdelavande/chat-ui-energy 16 days ago

403 when logged out?

#5 opened 16 days ago by

clem

reacted to clem's post with 🔥 16 days ago

Post

3970

Energy is a massive constraint for AI but do you even know what energy your chatGPT convos are using?

We're trying to change this by releasing ChatUI-energy, the first interface where you see in real-time what energy your AI conversations consume. Great work from @jdelavande powered by spaces & TGI, available for a dozen of open-source models like Llama, Mistral, Qwen, Gemma and more.

jdelavande/chat-ui-energy

Should all chat interfaces have this? Just like ingredients have to be shown on products you buy, we need more transparency in AI for users!