Using python version in big-data labs

How to use python version with spark in big-data labs ? Commands showing error.

What, you are getting error while using pyspark?
I used it just now.

[srpankaj12@gw01 ~]$ pyspark
Multiple versions of Spark are installed but SPARK_MAJOR_VERSION is not set
Spark1 will be picked by default
Python 2.7.5 (default, Sep 15 2016, 22:37:39)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-4)] on linux2
Type “help”, “copyright”, “credits” or “license” for more information.
Welcome to
____ __
/ / ___ / /
\ / _ / _ `/ __/ '/
/
/ .
_/_,// //_\ version 1.6.2
/
/

Using Python version 2.7.5 (default, Sep 15 2016 22:37:39)
SparkContext available as sc, HiveContext available as sqlContext.

1 Like

Thanks srpankaj, Its working now. Can you help where you take examples to practice ?

I am also finding it tough to find practice questions and dataset.

Pankaj

There are few exercises in this category - http://discuss.itversity.com/c/big-data/workshop-exercises