File size: 533 Bytes
0eeba1e
 
c5e70ea
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
# Description
A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).

If you decide to reuse this model, here are the LoRa and bnb configurations that were used for training:

```python
BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_compute_dtype=torch.float32,
)

LoraConfig(
    r=8,
    lora_alpha=8,
    lora_dropout=0.1,
    target_modules="all-linear",
    init_lora_weights="gaussian",
)
```