GitHub 项目简介: A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learnin…
README: NVIDIA Model Optimizer (referred to as Model Optimizer, or ModelOpt) is a library comprising state-of-the-art model optimization techniques including quantization, pruning, Neural…
README: Model Optimizer is now open source!
README: Since Model Optimizer is still pre-1.0, we provide a 1-release (~1-month) migration period after deprecation.
README: Post Training Quantization | Compress model size by 2x-4x, speeding up inference while preserving model quality!