Ports not available


#1

Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster


#2

You can pass custom port like this

spark-shell --master yarn --conf spark.ui.port=FIVE_DIGIT_NUMBER_LESS_THAN_65535

e.g… spark-shell --master yarn --conf spark.ui.port=12900


#3

spark-submit --master yarn–conf\ spark.ui.port=60025 sparkdem/src/main/python/retail/DailyRevenueAccumulators.py yarn-client /public/retail_db/ user/admin/daily_rev /data/retail_db/customers/part-00000

This is my command.


#4

I am not sure. Does that mean it is working or not working?


#5

It is working now.

I was using port number in the query when I had raised the issue. Not sure what happened(May be session was inactive). This happened few times that why I had posted in the blog. If it happens again I will try to recreate it and send a screenshot to you.

Thanks anyway.