How to use spark 2.0 from lab


#1

Hello All
Can anyone please suggest how to access spark 2.0 in lab . when we enter into spark shell by default it takes only 1.6.3 version .
Regards


#2

@pragtyag Use below command to start spark version in 2.0

export SPARK_MAJOR_VERSION=2


#3

Thanks Balu . So before entering into spark shell i need to set the version of spark like this ?


#4

@pragtyag Yes, First run the above export command and start sparks-shell. You will be able to launch spark2.


#5

Thanks Balu for the support and prompt response


#6