Step 01 - Setup Hadoop and Spark Environment as well as IDE

As part of the first step we will be setting up environment or signing up to the lab or accessing existing cluster and then perform below actions

  • If you do not have access to cluster or do not want to sign up for the lab then you can follow this
  • Setting up virtual environment on your PC - click here
  • Make sure all the technologies required for certification are available for use - HDFS, Spark with Scala, Spark with Python
  • Setup Scala IDE along with Eclipse with Maven or sbt