Next upHack for Humanity: San Francisco (powered by Google Gemini)
1:07:35

Democratizing AI Deployment

Deploying AI models remains a very complex problem, due to a deeply fragmented stack of incompatible tooling. The stack can be broken down into four areas: the orchestration layer, compression techniques, compiler infrastructure, and the hardware. We will cover each of these areas, and their unique challenges. When formulating optimal deployment recipes, each of these layers in the stack needs to be considered in a holistic manner, and decisions at one level affect the decision at every

Dmytro Spodarets
Dmytro Spodarets
Dec 18, 2023
Summary

Why deploying AI models is hard due to a fragmented stack, breaking down the orchestration layer, compression techniques, compiler infrastructure, and hardware, and why optimal deployment recipes must consider every layer holistically.