Hugging Face's logo

Spaces:
arsiba
/
GDPR-EDPB-AI
Running on Zero

App Files Community
3
arsiba commited on
Commit
593ff1c
·
1 Parent(s): 9c428d0

feat: use tinyLlama

Browse files
Files changed (2) hide show
  1. app.py +1 -1
  2. requirements.txt +0 -3
app.py CHANGED
@@ -16,7 +16,7 @@ with open("vector_db/metadata.pkl", "rb") as f:
16
 
17
  ST = SentenceTransformer("BAAI/bge-large-en-v1.5")
18
 
19
- model_id = "Qwen/Qwen-1_8B-Chat"
20
  bnb = BitsAndBytesConfig(
21
  load_in_4bit=True,
22
  bnb_4bit_use_double_quant=True,
 
16
 
17
  ST = SentenceTransformer("BAAI/bge-large-en-v1.5")
18
 
19
+ model_id = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
20
  bnb = BitsAndBytesConfig(
21
  load_in_4bit=True,
22
  bnb_4bit_use_double_quant=True,
requirements.txt CHANGED
@@ -7,6 +7,3 @@ numpy<2
7
  bitsandbytes
8
  accelerate
9
  spaces
10
- tiktoken
11
- einops
12
- transformers_stream_generator
 
7
  bitsandbytes
8
  accelerate
9
  spaces