Optimum documentation
Overview
Overview
Nvidia
AMD
Intel
AWS Trainium/Inferentia
Google TPUs
for Intel Gaudi
ExecuTorch
Furiosa
ONNX Runtime
Exporters
BetterTransformer
Torch FX
LLM quantization
Utilities
Overview
🤗 Optimum provides an integration with Torch FX, a library for PyTorch that allows developers to implement custom transformations of their models that can be optimized for performance.
How-to guides
Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use 🤗 Optimum to solve real-world problems.
Conceptual guides
High-level explanations for building a better understanding about important topics such as quantization and graph optimization.
Reference
Technical descriptions of how the Torch FX classes and methods of 🤗 Optimum work.