Commit
·
c6b8471
1
Parent(s):
a173908
Update app.py
Browse files
app.py
CHANGED
@@ -326,14 +326,12 @@ title_markdown = """
|
|
326 |
|
327 |
ONLY WORKS WITH GPU!
|
328 |
|
329 |
-
You can load the model with 8-bit or 4-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
330 |
|
|
|
331 |
Recommended configurations:
|
332 |
-
| Hardware
|
333 |
-
|
334 |
-
|
|
335 |
-
| T4-Medium (15G) | 4 |
|
336 |
-
| A100-Large (40G) | 16 |
|
337 |
"""
|
338 |
|
339 |
tos_markdown = """
|
|
|
326 |
|
327 |
ONLY WORKS WITH GPU!
|
328 |
|
|
|
329 |
|
330 |
+
You can load the model with 8-bit or 4-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
331 |
Recommended configurations:
|
332 |
+
| Hardware | A10G-Large (24G) | T4-Medium (15G) | A100-Large (40G) |
|
333 |
+
|-------------------|------------------|-----------------|------------------|
|
334 |
+
| **Bits** | 8 (default) | 4 | 16 |
|
|
|
|
|
335 |
"""
|
336 |
|
337 |
tos_markdown = """
|