Please explain the meaning of the below statement


sc= SparkContext

Hello Varun , please follow the videos from Mr. Durga about Apache Spark or Cloudera Certification

Please follow the above play list to get knowledge on Spark.


I am going through the course but was not able to understand this statement completely.
Hence asked.


SC means spark is a context object in spark is similar to Context’s object in map reduce paradigm(google for context object if you are not familiar).And sqlContext is an object of spark’s SQLContext , from 1.4v to higher hive context is readily available as sqlContext so there will be no need to create an hive context spark shell u can type sqlContext and hit enter.You can see the hive context as a class in the sql package.