HDPCD - Spark Context and Configuration


Originally published at: http://www.itversity.com/topic/hdpcd-spark-context-and-configuration/

Introduction As part of this topic we will understand what is SparkConf and SparkContext. SparkConf – Configuration information of the application SparkContext – Tells Spark how to access the cluster (YARN or Mesos or local) Application parameters and configurations SparkConf As part of this topic we will see details about SparkConf and how it is used while…