An Intro to Workflow Management with Prefect

As data pipelines become increasingly complex and interconnected, workflow management systems are being used to schedule and monitor tasks. Prefect is an open-source workflow management system designed for large-scale data processes. We’ll show how to get started with Prefect and also cover how to run Prefect on top of Dask on the cloud to parallelize workflows.

Categories: Day 3