prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

🦾 Take control of your AI agents

🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub

The Prefect API and backend

The home of the Prefect 1 UI

A simple guide to understand Prefect and make it work with your own docker-compose configuration.

Perfect Player Suite

Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

Example repository showing how to build a data platform with Prefect, dbt and Snowflake

Code examples showing flow deployment to various types of infrastructure

Tools for using Langchain with Prefect

Production RAG System Course

Prefect integrations with AWS.

Collection of Prefect integrations for working with dbt with your Prefect flows.

Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing

Template to quickly bootstrap a Prefect Collection

Prefect integrations with Ray

Prefect integrations with Google Cloud Platform.

Prefect tasks and subflows for interacting with shell commands.