Spark-shell/spark-submit

spark-submit

#1

I have been trying to use spark-shell/spark-submit , it is failing with the never-ending error

“18/02/28 21:51:45 ERROR SparkUI: Failed to bind SparkUI
java.net.BindException: Address already in use: Service ‘SparkUI’ failed after 16 retries! Consider explicitly setting the appropriate port for the service ‘SparkUI’ (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.”

I tried other options like
spark-submit --conf spark.ui.port=22322 spark.port.maxRetries=100 --master yarn-client --class Read_File /home/kchejerla/scala2/project9/target/scala-2.10/simple-project_2.10-1.0.jar

Still facing the same issue. Please check and let me know


#2

@Kranthi_Kumar Use this command to submit the jar.

spark-submit --conf spark.ui.port=22322 --master yarn-client --class Read_File /home/kchejerla/scala2/project9/target/scala-2.10/simple-project_2.10-1.0.jar

Sample Output:

Screenshot from 2018-03-01 11-45-16


#3