Skip to content

trannhatnguyen2/BI_DataLake_Azure

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

Building Data Lake on the Microsoft Azure Cloud Platform

Member of group

student_id class full_name
K204061440 K20406T Tran Nhat Nguyen

📕 Table of contents


🛠️ Tools

Tools
SQL Server
Azure Data Factory
Azure Data Lake Storage Gen2
Azure Databricks
Azure Synapse Analytics
Azure Key Vault
Azure Active Directory
Microsoft Power BI

🚀 Solution

Solution

The use case for this project is building an end-to-end solution by ingesting the tables from the on-premise SQL Server database using Azure Data Factory and then storing the data in Azure Data Lake Storage Gen2. Then Azure Databricks is used to transform the RAW data to the cleanest form of data and then we use Azure Synapse Analytics to load the clean data and finally use Microsoft Power BI to integrate with Azure Synapse Analytics to build an interactive dashboard. Also, we are using Azure Active Directory and Azure Key Vault for monitoring and governance purposes.


© 2023 NhatNguyen

About

Building Data Lake on the Microsoft Azure Cloud Platform

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published