Skip to content

miozilla/dataprochs

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
media
media
 
 
README.md
README.md
 
 

Repository files navigation

dataprochs 🐘🐝

dataprochs : Dataproc Cluster # Apache # Hadoop # MapReduce # Spark # YARN # HDFS

Objective

Create a Dataproc cluster in Google Cloud. Run Apache Spark job (estimates Pi value using Monte Carlo method). Modify number of workers in cluster.

Dataproc Cluster

dataprochs001.png

dataprochs002.png

dataprochs003.png

dataprochs004.png

dataprochs005.png

dataprochs006.png

dataprochs007.png

dataprochs008.png

dataprochs009.png

dataprochs010.png

dataprochs011.png

dataprochs012.png

dataprochs013.png

dataprochs014.png

dataprochs015.png

dataprochs016.png

dataprochs017.png

dataprochs018.png

dataprochs019.png

dataprochs020.png

About

dataprochs 🐘🐝 : Dataproc Cluster # Apache # Hadoop # MapReduce # Spark # YARN # HDFS

Topics

spark yarn hive hadoop cluster apache pyspark pig hdfs sparksql mapreduce dataproc node-manager node-worker

Resources

Readme
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages