OPEA
/

gemma-3-27b-it-int4-AutoRound

4-bit precision

Model card Files Files and versions Community

cicdatopea commited on 12 days ago

Commit

92b1713

·

verified ·

1 Parent(s): 1aa577a

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -68,7 +68,7 @@
     "use_cache": true,
     "vocab_size": 262208
   },
-  "torch_dtype": "float16",
   "transformers_version": "4.50.0.dev0",
   "vision_config": {
     "attention_dropout": 0.0,

     "use_cache": true,
     "vocab_size": 262208
   },
+  "torch_dtype": "bfloat16",
   "transformers_version": "4.50.0.dev0",
   "vision_config": {
     "attention_dropout": 0.0,