Accelerated Inference with Optimum and Transformers Pipelines
AI-generated summary Hugging Face released Optimum 1.2 to provide a unified API of performance optimization tools for training and running Transformer models on accelerated hardware. The tutorial demonstrates how to convert a RoBERTa model to the ONNX format and apply graph optimization and dynamic quantization to decrease model size.