Spark Session Keep on Failing


#1

Hi,
Looks like there is some issue with cluster. spark application keeps failing for every 5 to 10 min.
Hardly I can execute two to three commands only.
This is the command I am using to log into the spark:
spark-shell --packages com.databricks:spakr-avro_2.10:2.0.1 --master yarn-client --conf spark.ui.port=21234

Thanks,


#2

First of all there is typo in your spark-shell command. Instead of spark you mentioned spakr

spark-shell --packages com.databricks:spakr-avro_2.10:2.0.1 --master yarn-client --conf spark.ui.port=21234

What is the error you are getting every 5 to 10 minutes? It is tough to troubleshoot with out that information.