Spaces:

sandz7
/

loki

Runtime error

sandz7 commited on May 23, 2024

Commit

516209b

1 Parent(s): 9d8fdc0

update on input_ids

Files changed (1) hide show

app.py CHANGED Viewed

@@ -38,7 +38,7 @@ def llama_generation(input_text: str,
     header = '''Your are a helpful AI called amphisbeana.
     You will help the user, by giving accurate but creative response.\n'''
-    input_ids = llama_tokenizer.encode(input_text + header,
                                        return_tensors='pt').to('cuda')
     # llama generation looks for the numeric vectors not the tensors so there is no need for **input_ids rather just input_ids

     header = '''Your are a helpful AI called amphisbeana.
     You will help the user, by giving accurate but creative response.\n'''
+    input_ids = llama_tokenizer.encode(header + input_text,
                                        return_tensors='pt').to('cuda')
     # llama generation looks for the numeric vectors not the tensors so there is no need for **input_ids rather just input_ids