| [OPT](https://huggingface.co/facebook/opt-30b) uses decoder-only models like GPT-3. It was trained on 5 datasets with one containing a small portion of code. In this demo we use the 30B parameters model. The largest model has 176B parameters. | |
| |Model | # parameters | | |
| | - | - | | |
| | Decoder |30B | |