|
--- |
|
license: bsd-3-clause |
|
--- |
|
# CodeGen (CodeGen-Mono 350M) |
|
|
|
Clone of [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) converted to ONNX and optimized. |
|
|
|
## Usage |
|
|
|
```python |
|
from transformers import AutoTokenizer |
|
from optimum.onnxruntime import ORTModelForCausalLM |
|
|
|
model = ORTModelForCausalLM.from_pretrained("TextCortex/codegen-350M-optimized") |
|
tokenizer = AutoTokenizer.from_pretrained("TextCortex/codegen-350M-optimized") |
|
|
|
text = "def hello_world():" |
|
input_ids = tokenizer(text, return_tensors="pt").input_ids |
|
generated_ids = model.generate( |
|
input_ids, |
|
max_length=64, |
|
temperature=0.1, |
|
num_return_sequences=1, |
|
early_stopping=True, |
|
) |
|
out = tokenizer.decode(generated_ids[0], skip_special_tokens=True) |
|
print(out) |
|
``` |
|
|
|
Refer to the original model for more details. |
