|
EXL2 quants of [dbrx-base](https://huggingface.co/alpindale/dbrx-base). |
|
|
|
Tokenizer from [here](https://huggingface.co/Xenova/dbrx-instruct-tokenizer) |
|
|
|
[2.20 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.2bpw) |
|
[2.30 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.3bpw) |
|
[2.75 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.75bpw) |
|
[3.00 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.0bpw) |
|
[3.40 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.4bpw) |
|
[3.75 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.75bpw) |
|
|
|
[measurement.json](https://huggingface.co/turboderp/dbrx-base-exl2/blob/main/measurement.json) |