Pyspark has python2.7 but not 3.6 or latest

when I launched pyspark, it seems we don’t have python 3.6/3.7 version… how to get latest python in pyspark?

use export PYSPARK_PYTHON=python3.6 before using pyspark.

Thanks Ramesh. it works. however, when i execute that command via .sh file, this doesn’t seem to be working… not a showstopper for now, but wondering.

If you feel that is lab issue you have to send it to with complete details. If that is coding issue you have to post it on this forum so that someone will help you with that.