Note
The approach described in this post was later developed into the uv Dagger module. See its documentation for installation and usage.
A monorepo is a single repository that contains multiple projects. It is a popular way to organize codebases with many coupled components, and is also used at very big companies like Google, Facebook, and Twitter.
This series of posts is an opinionated tutorial for setting up production-grade Kubernetes clusters & deployments on AWS 1. It aims to be as detailed and correct as possible and will provide complete pieces of relevant source code.
This article is showcasing a surprising way of utilizing functools.wraps for building highly customizable and versatile Asset Factories in Dagster. Read it on Dagster's blog.
This is an export of my old 2022 Medium article. I've slightly modified it with new examples and changed some wording here and there. The tools mentioned in the article have stood the test of time in 2024!
Metaxy is a metadata layer for building versioned and incremental multimodal data and ML pipelines.
Run Dagster jobs on Ray, locally or on a remote autoscaling cluster.
Polars DataFrame support for Dagster assets and ops, now part of the main Dagster repository.
