spark-hadoop3

Spark 2.4.5 with Hadoop 3.2.1 and Delta 0.6.0

Download spark without hadoop and build base images

./spark.sh

docker build -t spark-with-hadoop3

docker run --rm -it spark-with-hadoop3 ../bin/spark-submit main.py

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
Dockerfile		Dockerfile
README.md		README.md
main.py		main.py
spark-env.sh		spark-env.sh
spark.sh		spark.sh