Unable to connect spark scala shell

scala

#1

getting below error

18/11/10 00:41:24 INFO DiskBlockManager: Shutdown hook called
18/11/10 00:41:24 INFO ShutdownHookManager: Shutdown hook called
18/11/10 00:41:24 INFO ShutdownHookManager: Deleting directory /tmp/spark-e6bfcc64-9a6a-4d4e-880b-72c86b7269a1/userFiles-b5e6ac65-528b-4307-920d-78e9fd4c835b
18/11/10 00:41:24 INFO ShutdownHookManager: Deleting directory /tmp/spark-e6bfcc64-9a6a-4d4e-880b-72c86b7269a1
18/11/10 00:41:24 INFO ShutdownHookManager: Deleting directory /tmp/spark-b2dd71d2-9aed-47d4-b416-590ac283041a


#2

You can try again with below command

spark-shell --master yarn --conf spark.ui.port=12335


#3

Hi
thanks it is working but want to know do we have to use the same port 12335 in CCA exam. Is the port number standard for all environment


#4

Its not compulsory until cloudera mentions you to do, You can pass custom port like this

spark-shell --master yarn --conf spark.ui.port=FIVE_DIGIT_NUMBER_LESS_THAN_65535