Accelerating and Scaling dbt for the Enterprise

Guide for large scale dbt projects. .

The Ultimate Guide to dbt

A comprehensive canvas guide to dbt, from the basics to advanced topics.

dbt in a real world scenario, A Beginner dbt tutorial

A beginner tutorial to understand dbt with a real world example.

Mastering dbt: Beginner to Pro

Paid Udemy course that covers theory, building a dbt project from scratch, and deploying to dbt Cloud.

Zero to Hero dbt

Complete course covering both theory & practice through real-world Airbnb use-case.

Data Engineering Zoomcamp

Data engineering course on cutting edge tools including dbt.

Analytics Engineering with dbt

Paid course offered by Uplimit covering the basics of dbt.

Advanced dbt

Another paid course by Uplimit covering the advanced dbt topics.

dbt Fundamentals

Official free course offered by dbt. Excellent for learning the basics of dbt Cloud.

Refactoring SQL for Modularity

Another dbt labs offered free course on dbt refactoring and CTE supercharging.

Learn DBT from Scratch

Guides you through a setup paired with Snowflake (decorated with extras).

Best Practices for Leveraging Amazon Redshift and dbt

An overivew of best practices on how to integrate dbt with Redshift, that includes information about performance tunning and dbt code optimizations.

dbt Jinja Functions Cheat Sheet - Datacoves

Jinja Functions Cheat Sheet that covers the Jinja additions in dbt Core.

Discovery API use-cases

Use-cases and examples for the dbt Cloud Discovery API.

dbt Docs as a Static Website

How to deploy dbt docs as a static website with App Engine and GitHub Actions.

dbt Monorepo Workflow

How to get started with the team dbt workflow.

BigQuery Ingestion-Time Partitioning and Partition Copy With dbt

Combining ingestion-time partitioning and partition copy is a great way to achieve better performance for your models.

Power up your data quality with grouped checks

How to use grouped checkes in dbt-utils to keep our data "on track".

Dry running our data warehouse using BigQuery and dbt

Use dbt & BigQuery dry run jobs to validate our 1000+ models in under 30 seconds.

Automatically generate ERD

Automatically generate ERDs and display in your docs site.

Business Intelligence Standards

Best practices in Business Intelligence standards for integrating with dbt.

Jinja cheatsheet

Jinja cheatsheet for dbt development.

Test SQL Pipelines against Production Clones using DBT and Snowflake

Leverage Snowflake Zero-copy-clones to run slim ci checks.

How we structure our dbt projects

How the dbt team structures its dbt projects.

dbt guide

Primer on how you should properly set up and configure your dbt workflow.

dbt for Data Transformation – Hands-on

Yet another tutorial for using dbt Cloud.

Start Modeling Data

Configuring Bigquery with your dbt project.

Accelerating Data Teams with dbt & Snowflake

A dbt & Snowflake workshop on financial data.

Creating a dev environment quickly on Snowflake

Setting up teh integraton with Snowflake.

How to set up a dbt data-ops workflow, using dbt cloud and Snowflake

Leverage GitHub Actions to set up CI/CD with dbt Core.

How to configure your dbt repository

Mono-repo or not mono-repo?

Best Practices for Optimizing Your dbt and Snowflake Deployment

Pocket guide on optimization best practices with Snowflake.

How to Deploy dbt to Production using GitHub Actions

Doing More With Less: Using DBT to load data from AWS S3 to Snowflake via External Tables

An alternative guide to set up your dbt-external-tables workflow.

Best Practices for your dbt Style Guide

Standards for well organized base layer with Airbyte ingestion.

Tips and Tricks about working with dbt

Tips from community members.

Best Practices for your dbt Style Guide

Standards for well organized base layer with Airbyte ingestion.

Writing Unit Tests for dbt

An overview about the package dbt-unit-testing.

How to create Kimball dimensional models with dbt

A step by step guide on how to build Kimball dimensional models with dbt.

ingestr

CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including Postgres, MongoDB, Salesforce, Shopify.

dbt-cli-mcp

MCP for dbt CLI.

dbt MCP Server

MCP tools to interact with dbt.

dbt-agent-skills

A curated collection of agent skills, built and maintained by dbt Labs, to help AI coding agents work more effectively with dbt.

Bonnard

Governed, multi-tenant MCP access to customer data. Turn your dbt models into a secure, per-customer MCP for AI agents.

dbt-streamdeck

Stream Deck plugin enables you to view the status of models and jobs as actions in your Stream Deck.

Auto Alert - diqu

Automate and streamline the alerting/ notification process for dbt test results using this versatile CLI companion tool. Receive detailed alerts & test metadata seamlessly on various platforms, promoting improved collaboration on dbt project issues 🐞🚀.

Tabula

Tabula is an end-to-end automation platform for data management tasks.

modal-dbt

This repo gives some code to run dbt jobs/actions using modal which is a serverless application framework.

Grai

Expose warehouse dbt tests in CI to upstream data consumers so production changes never break the warehouse.

Datafold

Gives a quick print out summary of changes so you can move fast and (not) break stuff!

Raycast dbt Metadata

Queries the dbt Cloud API to return some useful information about your models (number of tests, time they took to run etc…).

Cube

APIs, Caching, and Access Control on top of dbt Metrics.

FlexIt Analytics

Business Intelligence platform with deep dbt Cloud and CLI integration.

Raycast dbt Jobs

Raycast integration to monitor dbt Cloud Jobs.

Metaplane

Data Observaibility layer on top of your dbt + BI project.

Dbt + Machine Learning: What makes a great baton pass?

Landscape of ML utilities around dbt.

Soda

Integration of Soda's data observability platform and dbt.

Supported Adapters

Offically supported database adapters.

Lightdash

Open source Looker alternative with deep dbt integration.

Superset

Open source visualization layer for your Modern Data Stack.

Dagster and dbt: Better Together

Getting started with the dagster-dbt library.

fal

Add multi-language support (Python) to your dbt project.

Privacy Dynamics

Anonymize data in your dbt project.

prefect-dbt

Collection of Prefect integrations for working with dbt with your Prefect flows.

Acryl DataHub

A unified data catalog, governance, and observability platform. Use it to view models, docs, test results, and column-level lineage across your dbt projects and downstream dashboards.

Speeding up the dbt™ docs by 20x with React Server Components

A rewrite of dbt docs using Next.js with React Server Components and SSG.

How HomeToGo connected dbt and Superset to make metadata more accessible and reduce analytical overhead

A dbt<>Superset connector that leverages Superset's API capabilities and dbt's manifest.

Self-service Business Intelligence

Eliminate the need for a data modeling semantic layer in BI.

"Semantic-free" is the future of Business Intelligence

How to leverage dbt as a data catalog and semantic layer (joins, synonyms, etc.) that BI tools can just plug into.

Building an extension framework for dbt

How Monzo built an extension framework for dbt.

Why I moved my dbt workloads to GitHub and saved over $65,000

Save by replacing dbt Cloud with GitHub Actions.

“Is This You?” Entity Matching in the Modern Data Stack with Large Language models

An experiment in productionizing LLMs.

How HomeToGo connected dbt and Superset to make metadata more accessible and reduce analytical overhead

A dbt<>Superset connector that leverages Superset's API capabilities and dbt's manifest.

Self-service Business Intelligence

Eliminate the need for a data modeling semantic layer in BI.

Leveraging DBT as a Data Modeling tool

Reflection on one-year usage of dbt.

dbt + Materialize: Streaming to a dbt project near you

How to own your real-time transformation workflows like batch-based alternatives.

Who's really using dbt?

Behind the community of analytics engineers.

dbt and the Analytics Engineer — what's the hype about

Behind the upheaval of the analytics engineer profession.

Analyzing Fishtown's dbt project performance with artifacts

Using project artifacts to identify anomalies and room for refactoring.

Deploying and Running dbt on Azure Container Instances

Demonstration of integration with Azure.

Beware of DBT Incremental Updates Against Snowflake External Tables

Things you should be aware of when using external tables with dbt.

dbt development at Vimeo

Best practises from the Vimeo Data team.

Misata

Generate known-answer seed and test data for dbt models: declare the expected aggregates (revenue curves, rates, rollups) and assert your models return them exactly.

dq-tools

Make simple storing test results and visualisation of these in a BI dashboard leveraging 6 Data Quality KPIs.

BigQuery Stale data detection

Stale data detection with dbt and BigQuery dataset metadata.

Elementary

A dbt package that provides data anomaly detection as dbt tests.

Environment-dependent Unit Testing in dbt

Guide on how to run unit tests in dbt dynamically.

dbt-expectations

Port between dbt and great_expectations to extend out-of-the-box tests.

re_data

A dbt package for montioring metrics and detect anomalies.

Scherlok

Zero-config data quality CLI that complements dbt test with auto-detected anomalies (volume, schema drift, freshness, distribution, cardinality) on every materialized model after dbt run.

data-contract-validator

Fails the pull request when a model stops producing what a downstream consumer expects. Reads columns from catalog.json/manifest.json (falling back to a sqlglot parse of the SQL) and compares them against reverse-ETL destinations such as HubSpot CRM and against FastAPI/Pydantic services, in CI or…

How do you test your data

Suggestions on testing your data powered by the community.

How to unit test sql transforms in dbt

Unit test using source defer and generic custom tests.

DataKitchen Open Source Data Observability

Data breaks. Servers break. dbt and other tools break. Observability and alerting across and down your data estate. Save time with simple, fast data quality test generation and execution.

Aegis DQ

Agentic data quality framework that runs YAML rules against your warehouse (DuckDB, BigQuery, Snowflake, Databricks, Athena, Postgres), then uses LLMs to diagnose failures, trace root causes, and propose SQL fixes. Pairs naturally with dbt models as the validation layer after dbt run.

dbt-ci-cd

This setup is designed to demonstrate and implement best practices for testing and deploying dbt models.

How to Create CI/CD Pipelines for dbt Core

This post dives into the use of CI/CD for dbt Core, providing insights on dbt Cloud's Slim CI CICD job pattern and how to implement this using dbt Core.

Slim CI/CD with Bitbucket Pipelines

How to setup slim CI on Bitbucket.

dbt-docs-to-notion

A GitHub action for exporting dbt model docs to a Notion database.

How to review an analytics pull request

Checkpoints to consider when reviewing an analytics engineer PR.

Continuous Integration and Automated Build Testing with dbtCloud

Great and detailed blogpost on setting up Slim CI in dbt Cloud.

Performing a blue/green deploy of your dbt project on Snowflake

A very tidy and fail-safe way to run dbt in production by using two parallel production enviromnents.

How we speed up our CI runs by 10x using Slim CI

Limit data in long-running CI checks to improve developing experience.

DBT CI/CD Demo with BigQuery and GitHub Actions

A demo CI/CD implementation using GitHub Actions, including slim CI and unit tests.

Guide to Running DBT in Production

A guide to implementing a complete CI/CD process for a dbt project. The defer feature (for slim CI) and unit tests are used for continous integration (CI). For continuous delivery (CD), automatic deployment is advised in lower environments, and the Write-Audit-Publish pattern using the dbt clone…

dbt-beyond-the-basics

Showcase of advanced options when running CI for dbt.

dbt-cloud-download-artifacts-action

A GitHub action for downloading dbt artifacts from dbt Cloud CI jobs.

dbt-plan

terraform plan for dbt: diffs compiled SQL between two revisions to predict the DDL dbt run would emit. Names the columns an on_schema_change: sync_all_columns model will drop, the downstream models and data tests that drop breaks, and enforced-contract violations. Reads files only -- no warehouse…

Bruin

Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.

Orchestrate dbt Core jobs with Airflow and Cosmos

Run your dbt Core projects as Apache Airflow DAGs and Task Groups.

Building a Scalable Analytics Architecture with Airflow and dbt

Leveraging the dbt manifest in Airflow.

Auto-generating an Airflow DAG using the dbt manifest

Yet another article on extracting value from the manifest file.

Building a robust data pipeline with the dAG stack: dbt, Airflow, Great Expectations

Demonstration of a data orchestration project with Airflow.

Run dbt in Azure Data Factory

Primer about dbt on Azure Data Stack.

ModelDock

Hosted dbt-core scheduler. Connect your repo, pick dbt-core and adapter version, set a cron, run dbt-core in isolated Docker containers. No Airflow to manage.

Datanika

Open-source platform that runs dbt-core transformations alongside dlt-powered extract and load, with 36 connectors, cron scheduling, and run history in one web UI. AGPL-3.0, self-hostable with Docker Compose or Helm.

backfill

Terminal footer that pays you while dbt runs - one sponsored line on the bottom row during long commands (dbt Core and dbt Cloud CLI), 50% ad revenue share. Open-source Go CLI; never reads your code, queries, or output.

sqllens

TypeScript SQL parser and static analyzer: type inference, schema diagnostics, and column-level lineage. Reads Jinja-templated SQL (dbt models) natively, without rendering.

dbt-doctor

CLI health check and linter for dbt projects (SQL, YAML, Jinja): 190+ custom rules, optional SQLFluff, 0–100 score, GitHub Actions CI, and coding-agent skills.

dlin

Gives coding agents instant dbt lineage: no dbt compile, no Python, no grep. Fast model-level lineage CLI parsing SQL files directly (or a manifest.json), with experimental column-level lineage too.

Altimate Code

Open-source data engineering harness with 100+ deterministic tools for building, validating, optimizing, and shipping data products — usable from any LLM, across your warehouses. Ranked #1 on ADE-Bench (78%).

ERD Studio

VS Code extension that puts a visual ERD designer inside your dbt repo. Two-stage (logical/physical) canvas, drift detection against manifest.json, auto-generated selectors.yml, and AI-readable semantic models (YAML/JSON) with a built-in harness for Claude, Copilot, Gemini, and Codex.

dbtective

Rust-powered 'detective'/linter for dbt project/metadata best practices

docbt

Documentation Build Tool - Generate YAML documentation for dbt models with optional AI assistance. Built with Streamlit for an intuitive and familiar web interface.

dbt-bouncer

Tool to configure and enforce conventions for your dbt project.

dbt-column-lineage

Tool to visualize the column level lineage of dbt models.

metaplane cli

Various tools for working with data stacks.

dbt-column-lineage-extractor

Extract column level linage from dbt projects.

tdb

A sweet and speedy code generator for dbt.

diff2docs

Turn your diff into docs with the help of GPT-4o.

dbt-command-center

A local web application that provides a user-friendly interface to monitor and manage dbt runs.

dbt-score

Linter for dbt metadata.

dbt-llm-tools

RAG based LLM chatbot for dbt projects.

turboYAML

An AI-powered CLI tool for converting dbt SQL files to YAML using OpenAI.

datapilot

AI teammate for engineers to ensure best practices in their SQL.

dbt-exposures-crawler

Automate the creation of dbt exposures from different sources.

dlt(data load tool)

The open-source Python library for data loading.

Turntable VSCode extension

A handy docs composer and column-level lineage.

dbt-loom

A dbt-core plugin to weave together multi-project dbt-core deployments.

dbt-meshify

A dbt-core plugin that automates the management and creation of dbt groups, contracts, access, and versions.

dbot

An LLM-powered chatbot with the added context of the dbt knowledge base.

dbt-lineagex

A Column Level Lineage Graph for dbt.

Jinjat

Low-code application framework that turns your dbt projects into web apps.

fst: flow state tool

A tool to help you stay in flow state while developing dbt models.

dbt_tld

A self-updating dbt library that will maintain a list of current IANA/ICANN recognized top level domains.

dbt-model-finder

A Streamlit web app to find currently running dbt models.

dbtc Explorer

A Streamlit web app to explore the dbt Cloud API.

dbt-feature-flags

Feature Flags in dbt models.

dbtpal

A Neovim plugin for dbt model editing.

cookiecutter-dbt

Cookiecutter template for dbt projects.

turbovault4dbt

TurboVault4dbt is an open source tool that automatically generates dbt models according to datavault4dbt-templates.

dbtvault-generator

Generate DBT Vault files from yml metadata (supporting dbtvault package).

dbt-container-skeleton

All the basics to get a nice containerized dbt development environment.

oliver-twist

DAG auditing tool that audits the DBT DAG and generates a summary report.

dbt-sql-formatter

Makes your sql less bad.

dbterd

CLI to generate DBML file from dbt manifest.json.

dbt-cue

Generate dbt yml files using the CUE language.

dbt-artifacts-parser

It enables us to deal with catalog.json, manifest.json, run-results.json and sources.json as python objects.

GitHub Action: Cancel Running CI Job

This allows to always have the newest code commit running in the CI job without having to wait for the stale job runs to finish.

dbtc

Unaffiliated python interface to various dbt Cloud API endpoints.

dbt-osmosis

Enhance the developer experience significantly with workbench, output diffs, and YAML management.

pytest-dbt-core

Pytest dbt core is a pytest plugin for testing your dbt projects.

looker-gen

Generate lookml from dbt.

dbtenv

A version manager for dbt.

sqlfmt

This tool formats your dbt SQL code so you don't have to.

SQLFluff

SQL linter that supports dbt and Jinja templating.

drift

Multi-dialect SQL linter and formatter in Rust. Postgres, MySQL, SQLite, BigQuery, Snowflake. Single binary, ~448x faster than SQLFluff on plain SQL, with SARIF output for GitHub code scanning and a baseline mode for legacy adoption.

Build Data Access Layer on dbt

Package to build GraphQL API on top of your dbt project.

Run changed models based on Git status

Handy bash function to run changed models since last commit.

How we set up our computers for working on dbt projects

Things I wish I would have known when started working with dbt. Tools and hacks to improve developing experience.

fzf-dbt

Search dbt models interactively from terminal.

vscode-dbt-power-user

VSCode extension to give more clarity on model dependencies.

dbt-toolkit

Jetbrains IDE plugin for dbt lineage and more.

Your Essential dbt Project Checklist

Checklist on items necessary for a successful dbt project.

dbt Style Guide

Developing styleguide often referred in PR templates.

Clean your warehouse of old and deprecated models

Clean out warehouse models which are not existent in the project.

dbt-tips

Excellent companion to your dbt practice with rich collection of tips.

Understanding the scopes of dbt tags

Understanding the scopes of dbt tags.

Pre-commit hooks

Pre-commit hooks for checking data integity before schema change commit.

dbt-Workbench

An open UI for dbt providing model browsing, lineage visualization, run orchestration, documentation, environment management — without vendor lock-in. Designed for local, on‑prem, and air‑gapped deployments.

metadv

Python library for generating models from a declarative YAML configuration. It supports multiple data modeling approaches including Data Vault 2.0, Anchor Modeling, and Dimensional Modeling, with template packages for popular dbt libraries.

dbt-ui

A modern web-based user interface for dbt-core projects

Lunapad

Open-source notebook for running, exploring, and debugging dbt projects with interactive data analysis.

dbt-unirate

Currency exchange rate macros and models for dbt, powered by the UniRate API.

dbt_semantic_view/

This package lets you materialize Semantic Views via dbt and reference them from downstream models.

dbt-ml-inline-preprocessing

Feature Engineering in dbt.

dbt-snow-mask

A dbt package for Snowflake Dynamic Data Masking.

dbt-incremental-stream

A dbt package for Snowflake Streams.

dbt-dag-monitoring

A dbt package for monitoring airflow DAGs and tasks.

dbt-data-diff

Data-diff solution for dbt-ers with Snowflake.

dbt-tags

Tag-based masking policies management in Snowflake.

dbt-testgen

Generate dbt tests based on sample data.

dbt_otel_export

Takes dbt runs and turns them into OpenTelemetry traces.

dbt-assertions

Package to assert rows in-line with dbt macros.

dbt-ibis

Write your dbt models using Ibis, the portable Python dataframe library.

dbt-timescaledb

The TimescaleDB adapter plugin for dbt.

dbt-fake

Daily updated fake data for dbt learning and projects.

dbt_cloud_run_cost

Package to calculate dbt Cloud usage-based cost.

dbt-reconfigured

A dbt package containing reconfigured macros.

dbt-census-utils

A collection of dbt macros for working with Census data.

dbt-fabric

A dbt adapter for working with Microsoft Fabric Data Warehouses.

dbt-fabricspark

A code package from Microsoft for enabling dbt to work with Synapse Spark in Microsoft Fabric.

dbt-fabricsparknb

Dbt Fabric Spark Notebook Generator by Insight based on/forked form dbt-fabricspark by Microsoft.

dq-vault

Data Quality Observation of Data Vault layer.

dbt-translate

Translate numbers into words.

dbt-excel

A dbt adapter for working with Excel.

dbt_linreg

Linear regression in SQL using dbt.

dbt-snowflake-query-tags

Automatically tag dbt-issued queries with informative metadata.

snowflake-resource-monitoring

Yet another package to monitor Snowflake usage.

usagedata

Provides insights on the database/table level usage informations from Snowflake.

dbt_ml

Package for dbt that allows users to train, audit and use BigQuery ML models.

ddbt

This repo represents my attempt to build a fast version of DBT which gets very slow on large projects (3000+ data models). This project attempts to be a direct drop in replacement for DBT at the command line.

dbt-snowflake-monitoring

A dbt package to help you monitor Snowflake performance and costs.

datavault4dbt

Macros for staging and creation of all DataVault-Entities you need, to build your own DataVault2.0 solution.

DDO

Perform DataOps & administrative CI/CD on your data warehouse.

dbt-yaml-check

Checks that columns defined in YAML also exist in SQL.

data-diff

A command-line tool and Python library to efficiently diff rows across two different databases.

dbt-project-evaluator

This package highlights areas of a dbt project that are misaligned with dbt Labs' best practices.

dbt_constraints

Generate database constraints based on the tests in a dbt project.

dbt-date

Date logic and calendar functionality.

dbt-privacy

Macros to make it easier to protect your customers' data.

dbt-fivetran-utils

General macros and helpers.

dbt_metrics

Macros to support secondary calculations and generate business metrics.

dbt-metabase

Model synchronization from dbt to Metabase.

dbt-coves

CLI tool for generating a scaffold for your dbt project.

dbt-profiler

Data profiling and doc block generator.

dbt_utils

General macros library. A must have.

dbt_audit_helper

Macros for data audits that compare columns values and schemas between tables.

dbt-ml-preprocessing

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

dbt-external-tables

Macros to stage your external sources.

dbt-feature-store

Macros to build a feature store right within your dbt project.

dbt-codegen

Macros that generate dbt code, and log it to the command line.

dbt-init

Create a project and populate as much of the dbt project as possible.

dbt-artifacts

This package builds a mart of tables from dbt artifacts loaded into a table.

dbt-erdiagram-generator

This packages generate ERD diagrams from a dbt project.

Terraform-dbt Cloud Module

IAC in dbt Cloud via Terraform.

dbt2looker

Generate Looker views for dbt models.

dbt-coverage

Checks dbt docs and tests coverage.

dbt-meta-testing

Yet another coverage testing.

dbt-superset-lineage

Push and pull metadata between dbt to Superset.

dbtvault

Package for generating and executing ETL for Data Vault 2.0.

dbt-invoke

CLI for creating, updating, and deleting dbt property files.

dbt-unit-testing

Package which contains macros to support unit testing.

dbt_diving

A free to use dbt package with helper macros

trange_join

Macro to join dbt snapshots.

dbt_to_dbdiagram

Generate an ERD via dbdiagram.io from a dbt project.

Data Council Austin 2023

A conference for data teams.

State of Analytics Engineering 2023

A survey of pains, gains, and areas of investment for global data teams.

dbt Labs Tiktok

Official TikTok channel of dbt Labs.

Locally Optimistic

A Slack community of aspiring analytics leaders discussing and sharing lessons learned and challenges from their experiences in using data.

DataTalks.Club

Global online community of data enthusiasts. Podcasts and blogs, etc. are distributed with high frequency.

Metadata Weekly

Weekly substack about metadata, the metrics layer and MDS.

Data & Analytics Events in 2022

Great curated list of upcoming data analytics conferences.

Data Council Austin 2022

Worldwide community driven analytics conference with a handful of talks fitting to the dbt stack.

Automatically generate ERD

Automatically generate ERDs and display in your docs site.

Coalesce conference recordings

Recordings of Coalesce conferenfes from 2022 and after.

Coalesce 2021

Second iteration of the analytics engineer conference.

Coalesce 2020

Annual dbt conference full of fascinating use-cases.

dbt meetups

List of community led dbt meetups.

Analytics Engineer Roundup

Official dbt Labs newsletter on topics of the MDS.

Benn Stacil's Newsletter

Tought-provoking reads from founder of Mode.

Data Engineering Weekly

Weekly newsletter of recent trends in Data Engineering.

Data Engineering Podcast

One of the most popular data engineering podcasts covering great concepts and new products.

Analyitics Engineer Podcast

Official podcast of dbt Labs.

dbt Slack

Energy-filled hub of analytics engineers (Highly recommended).

r/dataengineering

Subreddit of data engineering topics.

Drill to Detail Podcast

Special guests discussing big data, business intelligence, modern data stack.

#dbtips

Newsletter about dbt, with tips and tutorials on various topics.

dbt-snowflake-template

Production-ready template deploying dbt project to Snowflake using GH Actions.

datafold-dbt-ci-advanced

Add 4 more integrations to your dbt CI pipeline: Slim CI, pre-commit hooks, Data Diffs, and Slack notifications.

NBA_Data_Modeling

Using the official NBA API, this repo explains how to ingest, store, transform, and serve insights.

awesome-public-dbt-projects

A curated list of awesome public dbt projects.

mdsinabox

MDS in a box deployed anywhere.

gee_production_gatekeepers

A demonstration of production gatekeepers in Snowflake and BigQuery.

mdsfest-opensource-mds

Demo project for open source MDS.

f1-data-pipeline

F1 Data Pipeline.

transfermarkt-datasets

E2E dbt project for scraping and transforming football data from Transfermarkt.

dbt_github_archive_bigquery

A dbt project for GitHub Archive data on BigQuery.

dbt_workspace

A workspace template for dbt demos.

Cloud Cost Monitoring

A dbt project to monitor cloud costs.

Analytics Engineer Survey 2023

Repo containing data and dbt template of the survey.

Tracking the Fake GitHub Star Black Market with Dagster, dbt and BigQuery

Explore the topic of fake GitHub stars.

Data-aware orchestration

Dagster's ability to create a global dependency graph between different dbt projects.

GitLab Data Team

GitLab's open source dbt project.

attribution-playbook

A worked example to demonstrate how to model customer attribution.

mrr-playbook

A worked example to demonstrate how to model subscription revenue.

Use dbt inside Visual Studio Code development containers

Set up your dbt environment with pre-installed extensions.

dag-stack

Dbt-Airflow-GreatExpectations Stack.

Jaffle Shop

A self-contained dbt project for testing purposes.

Spotify User Analytics

Sample dbt project with Spotify user data.

dbt-github-workflow

Deploy BigQuery + Airflow.

airflow-dbt-demo

Demonstration of Airflow integration.

aws athena x dbt

How to build a small and modern data infrastructure.

Part 1 – Redshift

Part 2 – Glue

Part 3 – EMR on EC2

Part 4 – EMR on EKS

Part 5 – Athena

Make Open Data

A production grade ELT with tests, documentation and CI/CD (GHA) about french open data (housing, demography, geography, etc). Can be used to learn with voluminous and ambiguous data. Contributions are welcome.

Part 1 Modelling on PostgreSQL

Part 2 ETL on PostgreSQL via Airflow

Part 3 Modelling on BigQuery

Part 4 ETL on BigQuery via Airflow

Part 5 Modelling on Amazon Athena

Part 6 ETL on Amazon Athena via Airflow