INT8
An 8-bit integer representation commonly used to reduce model memory footprint and accelerate inference through quantized arithmetic.
Related Concepts
- Quantization
- BF16
- Calibration
- Inference
An 8-bit integer representation commonly used to reduce model memory footprint and accelerate inference through quantized arithmetic.