I have launched pyspark REPL in itversity lab. Unable to find the application url. History server is always having a delay.
pyspark --master yarn --conf spark.ui.port=12345
Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs
- Click here for access to state of the art 13 node Hadoop and Spark Cluster