Data Analysis - Spark SQL and Data Frames using Python


Originally published at:

Data Frames and Spark SQL As part of this lesson we will get into details of Spark SQL and Data Frames Creating tables in Hive Different file formats while creating tables Loading data into Hive tables Using PySpark Pre-defined functions as part of SQL Different transformations – Joins, aggregations, sorting, set operations and more Analytics…