Unresolved dependency: org.apache.spark#spark-core 2.10;1.6.2: not found

apache-spark

#1

Hi I am trying to setup SBT dependencies in IDE Intellij and following is my file. I am getting following error: unresolved dependency: org.apache.spark#spark-core 2.10;1.6.2: not found.

Could you please help me to resolve this issue…

===============================================

name := “wlabs”

version := “1.0”

scalaVersion := “2.11.8”

libraryDependencies += “mysql” % “mysql-connector-java” % “5.1.36”

libraryDependencies += “com.typesafe” % “config” % “1.3.1”

libraryDependencies += “org.apache.spark” % “spark-core 2.10” % “1.6.2”

============================================================

Here is the error log:

Error:Error while importing SBT project:

[info] Resolving org.scala-lang#scala-compiler;2.11.8 …
[info] Resolving org.scala-lang#scala-reflect;2.11.8 …
[info] Resolving org.scala-lang.modules#scala-xml_2.11;1.0.4 …
[info] Resolving org.scala-lang.modules#scala-parser-combinators_2.11;1.0.4 …
[info] Resolving jline#jline;2.12.1 …
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.apache.spark#spark-core 2.10;1.6.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.apache.spark:spark-core 2.10:1.6.2 (C:\Users\kiran\IdeaProjects\untitled\build.sbt#L11-12)
[warn] ± wlabs:wlabs_2.11:1.0
[trace] Stack trace suppressed: run 'last :ssExtractProject’ for the full output.
[trace] Stack trace suppressed: run 'last :update’ for the full output.
[error] (
:ssExtractProject) sbt.ResolveException: unresolved dependency: org.apache.spark#spark-core 2.10;1.6.2: not found
[error] (
:update) sbt.ResolveException: unresolved dependency: org.apache.spark#spark-core 2.10;1.6.2: not found
[error] Total time: 1 s, completed May 5, 2017 1:19:20 PM
Java HotSpot™ 64-Bit Server VM warning: ignoring option MaxPermSize=384M; support was removed in 8.0

See complete log in file:/C:/Users/kiran/.IntelliJIdea2017.1/system/log/sbt.last.log

#2

hi @rajeshv28
in intellij go in the file->settings>build
sbt and check the auto import

then close and reopen
when adding the
libraryDependencies += “org.apache.spark” % “spark-core 2.10” % "1.6.2"
you should see a yellow text saying to import prj
it will downloads what needed
so sbt console
will not fail

mario
ps I am using

scalaVersion := “2.11.8”

// https://mvnrepository.com/artifact/mysql/mysql-connector-java
libraryDependencies += “mysql” % “mysql-connector-java” % "5.1.36"
libraryDependencies += “com.typesafe” % “config” % "1.3.1"
libraryDependencies += “org.apache.spark” %% “spark-core” % “1.6.2”


#3

Hi Guys, after auto importing/refreshing , am still getting unknown artifact : Not resolved or indexed
@balu4bigdata @soumalya

Error:Error while importing SBT project:

[warn]   https://repo1.maven.org/maven2/org/apache/spark/spark-core 2.10/1.6.3/spark-core 2.10-1.6.3.pom
[info] Resolving org.scala-lang#scala-compiler;2.12.1 …
[info] Resolving org.scala-lang#scala-reflect;2.12.1 …
[info] Resolving org.scala-lang.modules#scala-xml_2.12;1.0.6 …
[info] Resolving jline#jline;2.14.1 …
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.apache.spark#spark-core 2.10;1.6.3: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.apache.spark:spark-core 2.10:1.6.3 (E:\Hadoop\Scala_examples\build.sbt#L8-9)
[warn] ± default:scala_examples_2.12:1.0
[trace] Stack trace suppressed: run 'last :ssExtractDependencies’ for the full output.
[trace] Stack trace suppressed: run 'last :update’ for the full output.
[error] (
:ssExtractDependencies) sbt.ResolveException: unresolved dependency: org.apache.spark#spark-core 2.10;1.6.3: not found
[error] (
:update) sbt.ResolveException: unresolved dependency: org.apache.spark#spark-core 2.10;1.6.3: not found
[error] Total time: 2 s, completed Jul 10, 2017 9:25:42 AM
Java HotSpot™ 64-Bit Server VM warning: ignoring option MaxPermSize=384M; support was removed in 8.0

See complete log in file:/C:/Users/user/.IdeaIC2017.1/system/log/sbt.last.log

#4

ciao try to be less strict…

name := "bigdatalab_spark"

version := "1.0"

scalaVersion := "2.10.6"


// https://mvnrepository.com/artifact/mysql/mysql-connector-java
libraryDependencies += "mysql" % "mysql-connector-java" % "5.1.36"
libraryDependencies += "com.typesafe" % "config" % "1.3.1"
libraryDependencies += "org.apache.spark" %% "spark-core" % "1.6.2"

it works for me


#5

Hi Supermario,

I am getting the above same error. I tried to re install both SBT and Scala. But still the problem persists.

Please help.

thanks,
Raghavendra.