Spaces:

ChandimaPrabath
/

eve

Running

Chandima Prabhath commited on Apr 9

Commit

5c8a7b9

1 Parent(s): 3b132e6

Remove max_tokens parameter from LLM request in generate_llm function for cleaner API call.

Files changed (1) hide show

polLLM.py CHANGED Viewed

@@ -63,7 +63,6 @@ def generate_llm(
                 model=model,
                 messages=messages,
                 seed=seed,
-                max_tokens=4000,
             )
             text = resp.choices[0].message.content.strip()
             logger.debug("LLM response received")

                 model=model,
                 messages=messages,
                 seed=seed,
             )
             text = resp.choices[0].message.content.strip()
             logger.debug("LLM response received")