Spark shell shut down quite often for every 10 min

spark-shell
#1

Spark shell shut down quite often for every 10 min. I need to restart the shell again and again.
Please resolve this issue asap.

Thanks
Dileep

0 Likes

#2

What is the spark-shell command you are using?

0 Likes

#3

spark-shell --master yarn --conf spark.ui.port=12587 --num-executors 4 --executor-cores 2 --executor-memory 2G

This is the command i use to login to spark shell.

0 Likes