Unable to open Spark-Shell


#1

I am not able to launch spark-shell. I tried various options including spark-shell –master yarn –conf spark.ui.port=12345 but it doesn’t work. After it starts, it shows reconnect momentarily and then takes you back to home. Can you please look into it and suggest me a way to resolve the issue?


#2

@Purnima_Sharma The resources become busy for some time at that point in time. Now the cluster is working fine. Try below command to launch spark-shell and let us know.

spark-shell --master yarn --conf spark.ui.port=10234


#3

The server always shuts down around 12 PM EST. It works fine in the morning. I was wondering if this will be a constant issue. I am not able to use it since it is always unavailable during the daytime.