For several years, Spotify used Luigi and Flo to orchestrate batch data pipelines in Luigi and Flo respectively. However, in 2019, Spotify decided to implement a new scheduling/orchestration system to make upgrades more frictionless and enable platform automation based on observations of tasks and workflows. Specifically, Spotify sought a managed service that could orchestrate tasks within a workflow, run business logic in a controlled environment, and enable users to define workflows and tasks through an SDK. For these reasons, Spotify adopted Flyte (originally developed and OSS’ed at Lyft). While the migration to Flyte is still ongoing, the transition to this tool has been easier since Flyte has a similar entity model and was designed to address similar constraints.