June 29, 2022, 3:59 a.m. | /u/emilec___

Artificial Intelligence www.reddit.com

nebullvm is an open-source library that takes an AI model as input and outputs an optimized version that runs much faster on your hardware, **usually achieving 2 to 5 times faster inference** **without losing accuracy** (benchmarks below for Option A), or even more if you specify that you are willing to sacrifice some accuracy for a lighter model with even lower latency, using compression techniques (Option B, leveraging multiple quantization methods \[1\], soon also pruning \[2\] and more)

[https://github.com/nebuly-ai/nebullvm](https://github.com/nebuly-ai/nebullvm)

nebullvm …

artificial deep learning inference learning open source release

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Sr. Data Science Consultant

@ Blue Yonder | Bengaluru

Artificial Intelligence Developer

@ HP | PSR01 - Bengaluru, Pritech Park- SEZ (PSR01)

Senior Software Engineer - Cloud Data Extraction

@ Celonis | Munich, Germany

Finance Master Data Management

@ Airbus | Lisbon (Airbus Portugal)

Imaging Support Associate

@ Lexington Medical Center | West Columbia, SC, US, 29169