Apache Spark 2 using Python 3 - Essentials


Originally published at: https://kaizen.itversity.com/apache-spark-2-using-python-3-essentials/

Let us understand the essentials to develop Spark 2 based Data Engineering Applications using Python 3 as Programming Language. Overview of Data Engineering Setup Development Environment Python Essentials – Overview Development Life Cycle – Python Apache Spark – Overview Data Frames and Spark SQL – Overview Development Life Cycle – Pyspark Tasks and Exercises –…