pySpark is not picking up 'sc'

[Pruthvi_Konda]

sc is not picking up by pyspark on Big data labs so i’m not able to proceed further.

[pramodvspk]

Unable to launch spark-shell

You can resolve it either following any one of following solutions: Solution-1: Set Spark UI Port explicitly as shown below spark-shell --conf "spark.ui.port=10101" //Here we are explicitly setting spark ui port to some random port which is not in use in above example I chosen 10101 but you can choose any proper port number Solution-2: Increase spark.port.maxRetries as shown below spark-shell --conf "spark.port.maxRetries=100" //Here we are setting spark.port.maxRetries to 100 so it will…

[Pruthvi_Konda]

when trying to run Spark-Shell, i get below issue

There is insufficient memory for the Java Runtime Environment to continue.