Hive in Spark Context

Originally published at: http://www.itversity.com/topic/bde-hive-in-spark-context-scala/

Introduction Let us see how queries against hive tables can be executed in Spark Context Accessing Spark SQL through spark-shell Spark SQL (CLI) Using HiveContext Running queries (creates dataframes) Further processing of data Spark SQL and CLI Spark SQL can be run using spark-sql CLI (it is not available in distributions such as Cloudera) spark-shell…