Data Frames and Spark SQL


Originally published at:

As part of this lesson we will get into details of Spark SQL and Data Frames Creating tables in Hive Different file formats while creating tables Loading data into Hive tables Using Spark Shell Pre-defined functions as part of SQL Different transformations – Joins, aggregations, sorting, set operations and more Analytics and Windowing Functions Processing…