Add Dependencies to the Project

Let us define required dependencies in build.sbt to build Spark Applications using Scala as Programming Language.

  • Plugin to read run time properties
    • groupId: com.typesafe
    • artifactId: config
    • version: 1.3.2
  • Plugin to develop applications using Spark SQL APIs
    • groupId: org.apache.spark
    • artifactId: spark-sql_2.11
    • version: 2.4.3
name := "retaildatabricks"

version := "0.1"

scalaVersion := "2.11.12"

libraryDependencies += "com.typesafe" % "config" % "1.3.4"
libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.3"%

Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster