Accessing Spark UI on the Cluster

pyspark-shell
apache-spark
pyspark
spark-shell
#1

Hi @itversity, I have started spark shell and the spark UI has been created at http://172.16.1.100:4045, but I am not access the UI when I paste the URL in the browser. Please let me know how to access the Spark UI.

0 Likes

#2

Sorry for asking as reply to this question. I am just looking here how to post a new question. I know how to reply for a question. I am not seeing anything like ‘ask a question or post a question’.

0 Likes

#3

@jeevakrishnarg - Please use + New Topic link which is present in right side corner. it will allow the update the subject, category, details and click + Create Topic.

0 Likes

#4

Thanks, Got it…

0 Likes

#5

@pramodvspk You are trying to access Spark UI with private(internal) ip (172.16.1.100) which is accessible from only that VM. For public access you need to use either public ip (149.56.24.210) or host-name (gw01.itversity.com). So your Spark UI can be accessible from anyone of below URLs(if your spark-shell still running on 4045 port).

  1. Using Public IP: http://149.56.24.210:4045
  2. Using Host Name: http://gw01.itversity.com:4045

Hope this helps!

1 Like

#6

@venkatreddy-amalla, thank you

0 Likes