Tracking URL Spark shell

Whenever I run pyspark --master yarn --conf spark.ui.port=12888 . I am not getting as much details as in video and do not get the tracking URL. How do I find the tracking URL for spark in my lab?

Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster

You can go to resource manager and track from there. Our admin has disabled extensive logging due to which the tracking url is not generated.

Here is the URL for resource manager - http://rm01.itversity.com:19088/cluster

1 Like