microsoft/Olive

This is stars and forks stats for /microsoft/Olive repository. As of 03 May, 2024 this repository has 864 stars and 78 forks.

Olive Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation. Given a model and targeted hardware, Olive composes the best suitable optimization techniques to output the most efficient model(s) for inferring on cloud or edge, while taking a set of constraints such as accuracy and latency into consideration. Since every ML accelerator vendor implements their own acceleration tool chains to make...