Big Data Docker Data Science Spark Spark3 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook

Spark 3.1.x实现MQ Source的方法

This Repository contains the small projects related to Hive, Hadoop, and Spark. Its my contribution of learning new technology and provide my concise knowledge on big data different infrastructures.

This workshop aims to make use of telco data set to work with CDP utilizing the Data services (CDF, CDE, CDW & CML) for Telecom Churn Use Case.

A sample demo to check latest spark, big query connector and scala 2.12

Spark-Programming-In-Python

github.com/apache/spark/common/network-yarn module with shaded dependenices