Loading…
Back To Schedule
Wednesday, November 20 • 5:20pm - 5:55pm
Flyte: Cloud Native Machine Learning & Data Processing Platform - Ketan Umare & Haytham AbuelFutuh, Lyft

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Flyte is the backbone for large-scale Machine Learning and Data Processing (ETL) pipelines at Lyft. It is used across business critical applications ranging from ETA, Pricing, Mapping, Autonomous, etc. At its core is a Kubernetes native workflow engine that executes 10M+ containers per month as part of thousands of workflows. The talk will focus on,
- Architecture of Flyte and its specification language to orchestrate compute and manage data flow across disparate systems like Spark, Flink, Tensorflow, Hive, etc.
- Deploying highly scalable and fault tolerant Kubernetes Operators
- Learnings from operating Flyte across multiple Kubernetes clusters and using other CNCF technologies like gRPC, Envoy, FluentD, Kustomize and Prometheus.
- Use-cases where Flyte can be leveraged
The talk will conclude with a demo of a machine learning pipeline built using the open source version of Flyte.
Speakers
avatar for Haytham AbuelFutuh

Haytham AbuelFutuh

Software Engineer, Lyft
Haytham Abuelfutuh is a software engineer at Lyft and leads the Flyte backend team. During his tenure at Lyft, Haytham has helped build Flyte from the ground up, built and shipped Kubernetes operators and investigated and optimized Flyte system performance on k8s. Before Lyft, Haytham... Read More →
avatar for Ketan Umare

Ketan Umare

Senior Staff Software Engineer, Lyft
Ketan Umare is a senior staff software engineer at Lyft and founder of the Flyte project. Before Flyte he worked on ETA, routing and mapping infrastructure at Lyft. He is also the founder of Flink Kubernetes operator and contributor to Spark on K8s. Prior to Lyft he was a founding... Read More →

Flyte Kubecon pdf
Wednesday November 20, 2019 5:20pm - 5:55pm PST
Room 14AB - San Diego Convention Center Mezzanine Level
  Machine Learning + Data