How to run Spark eclipse or scala IDE locally


#1

i am trying to run Wordcount. scala as scala application in eclipse.But i got following error please help me out

'with spark-1.6.2
context: Running Spark version 1.6.2
Exception in thread “main” java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class

with spark 2.1.11

java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)
java.lang.NullPointerException
at java.lang.ProcessBuilder.start(Unknown Source)

15:02:32 WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 1, localhost, executor d’


#2

@kinand: Can you please post your Wordcount.scala program here to assist further?
Thank you
Venkat


#3

@kinand

Have you installed Hadoop & Spark locally??, if not but you want to practice Scala in local system, there is no need to install Hadoop & Spark. try Wordcount.scala running without Spark API.


#4

Hi Ravi , I haven’t install locally,i musing maven tool ,i resolved error by giving path of winutills.exe in Environment variables.Because i am running in windows.