Spark-shell failed to launch


#1

ERROR SparkUI: Failed to bind SparkUI
java.net.BindException: Address already in use: Service ‘SparkUI’ failed after 16 retries! Consider explicitly setting the appropriate port for the service ‘SparkUI’ (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.


#2

@anilmnt82 Use below command and launch spark. Use different port number between 10000 to 60000 explicitly.

spark-shell --conf spark.ui.port=22344 spark.port.maxRetries=100 --master yarn-client


#3