dbt Demo

Aim of this demo is to create a simple datamart for demonstrating dbt as data transformation framework.

---
title: Reporting Data Model
---
erDiagram 
    fct_order_positions }o--|| dim_customers : Customer_Key
    fct_order_positions }o--|| dim_products : Product_Key

Loading

The data used is taken from an e-commerce dataset from the Brazilian e-commerce platform provider Olist, which was published on kaggle.

Download Data

Run the following code to download the dataset:

Note: Needs setup kaggle API

pipenv run python data/prepare_data.py --download

More information about the dataset and how to download and prepare the data could be found here in the data folder.

Upload Data to GCS

Upload the data to Google Cloud Storage (GCS).

Setup and Run dbt

Read here

Todo

• Create step for step tutorial for developing the dbt models in this project