Apache Spark 1.6 - Transform, Stage and Store - Connecting to the environment

As part of this topic, we will cover how to connect to the environment

  • Once we set up the spark we can launch it with launch terminal in mac or ubuntu and command prompt in windows
  • If you have Quickstart VM or Hortonworks Sandbox we can do ssh or we can directly launch console and use pyspark in it.

Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster