I wanted to set my own properties for sc, hence i did sc.stop() after i logged into spark-shell. However it throwing an error when i set new properties.
This is how I have proceeded:
spark-shell --master yarn --deploy-mode client --conf spark-ui-port=12355 --num-executors 1 --executor-memory 2048M
val conf = new SparkConf().setMaster(“yarn-new”).setAppName(“Practice”)
val sc = new SparkContext(conf)
when i try to read a file ; it says No active SparkContext.
Kindly tell me where I am going wrong; also, how do i restart sparkcontext.
Please find the screenshots attached.
Kindly help me resolve this.