hf-inference-endpoint

Build error

chansung commited on Sep 2, 2023

Commit

8ebe6a8

1 Parent(s): a8a7795

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -398,7 +398,7 @@ Name for your new endpoint""")
                         gr.Markdown("""### Max Batch Total Tokens
     Number of tokens that can be passed before forcing waiting queries to be put on the batch. A value of 1000 can fit 10 queries of 100 tokens or a single query of 1000 tokens.""")
-                        max_batch_total_tokens = gr.Number(
                             value=None,
                             interactive=True,
                             show_label=False,

                         gr.Markdown("""### Max Batch Total Tokens
     Number of tokens that can be passed before forcing waiting queries to be put on the batch. A value of 1000 can fit 10 queries of 100 tokens or a single query of 1000 tokens.""")
+                        max_batch_total_token = gr.Number(
                             value=None,
                             interactive=True,
                             show_label=False,