Spaces:

HumbleBeeAI
/

llm_host

Running

Bahodir Nematjonov commited on Feb 10

Commit

de06a50

1 Parent(s): accc9aa

model changed

Files changed (1) hide show

utils.py CHANGED Viewed

@@ -5,7 +5,7 @@ async def generate_stream(query: str):
     """Generates streamed responses from Ollama using LLaMA 3 or Mistral."""
     try:
         stream = ollama.chat(
-            model="llama3",  # Change to 'mistral' if needed
             messages=[{"role": "user", "content": query}],
             stream=True
         )

     """Generates streamed responses from Ollama using LLaMA 3 or Mistral."""
     try:
         stream = ollama.chat(
+            model="llama3.2",  # Change to 'mistral' if needed
             messages=[{"role": "user", "content": query}],
             stream=True
         )