The State of Open Source AI: Deployment Engines, Licences, & Hardware // Casper da Costa-Luis // LT

// Abstract
Following the LLMs in Production survey results, we picked the 3 hottest topics to bring some clarity in the current fast-paced mess of Open Source innovation: deployment (starting & maintaining a project is an ongoing unsolved problem) licenses (recently "solved"/permissive for a lot of good architectures, but will remain a mess for data for years) hardware (cost-vs-capability ratio is decreasing, but far more importantly, software portability is finally actually being solved!) Find out what, why, and how in …

abstract current deployment hardware innovation llms luis open source production project state survey topics