How to use Spark-shell / pyspark for Spark 2

apache-spark
How to use Spark-shell / pyspark for Spark 2
0.0 0

#1

Hi,

I am new to itversity labs, wants to use spark-shell, pyspark shells for Spark 2. When I launched the shell, I could see Spark v1.6.0 was launched. Please help me to login into Spark v2 shell.

Thanks,
Srinivas


#2

got the answer,
export SPARK_MAJOR_VERSION=2
then
spark-shell


#3