Next upHack for Humanity: San Francisco (powered by Google Gemini)
55:14

Gen AI data chain at scale

Generative AI workflows heavily rely on data-centric tasks—such as filtering samples by annotation fields, vector distances, or scores produced by custom classifiers. At the same time, computer vision datasets are quickly approaching petabyte volumes, rendering data wrangling difficult. In addition, the iterative nature of data preparation necessitates robust dataset sharing and versioning mechanisms, both of which are hard to implement ad-hoc. In this workshop we will introduce DVCx - a

Dmytro Spodarets
Dmytro Spodarets
Nov 17, 2023
Summary

A workshop introducing DVCx for the generative AI data chain at scale, addressing data-centric tasks, petabyte-scale computer vision datasets, and the dataset sharing and versioning needed for iterative data preparation.