TheStageAI
/

Elastic-Qwen2.5-7B-Instruct

psynote123 commited on 10 days ago

Commit

fe7e76a

verified ·

1 Parent(s): 290fb15

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md CHANGED Viewed

@@ -152,7 +152,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
-| H100 | 200 | 175 | 162 | 135 | 60 | 199 | - |
 | L40S | -1 | -1 | -1 | -1 | -1 | -1 | - |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
+| H100 | 201 | 173 | 162 | 135 | 62 | 201 | - |
 | L40S | -1 | -1 | -1 | -1 | -1 | -1 | - |