Optimum

Overview

Conceptual guides

Nvidia

AMD

Intel

Neural Compressor

OpenVINO

IPEX

Tutorials

AWS Trainium/Inferentia

Google TPUs

Habana

Furiosa

ONNX Runtime

Exporters

BetterTransformer

Torch FX

LLM quantization

Utilities

You are viewing v1.23.1 version. A newer version v1.25.2 is available.

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Notebooks

Notebook	Description
How to run inference with the IPEX	Explains how to export your model to IPEX and to run inference with IPEX model on text-generation task