Rust

Scaling Data Processing for Training Workloads at DeepL Research with Rust ▶ Recording 📝 Transcript

Jonas Dedden, Johanna Goergen

This talk will detail how we used Rust to solve a number of resource utilization inefficiencies while scaling data pre-processing to a petabyte scale and enable next-generation model training at DeepL. Besides other...