Spark SQL - Processing data using Data Frames


#1

Originally published at: https://kaizen.itversity.com/topic/cca175-spark-sql-processing-data-using-data-frames-scala/

Let us get into details related to Data Frames. Data Frames can be created from RDD, by using toDF function We can register Data Frame as temp table and start running queries against it Querying hive tables (which is already explored) Querying tables from remote databases using JDBC Create Data Frame and Register as temp…