Need help on installation and setup of sbt and spark

sbt
eclipse
spark

#1

i have access to itversity cluster, i want to create a jar file and submit spark programs on cluster

there are many videos, i have eclipse installed, how to do a project where i can create a jar file on eclipse

and submit on cluster . please suggest how to proceed what videos exactly i need to follow

i tried to install scala styple 0.9.0 on

eclipse verison Version: Neon.3 Release (4.6.3)
Build id: 20170314-1500

and when i go to file, new , there is no scala

Regards
AR


#2

i installed eclipse photon 4.8.0 and installed scala, how should i created and project in eclipse IDE which is on windows and submit a program on spark using itveristy cluster ?

there is one .sbt and 2 project files ,which one to conisder.(might be due to previous installations),i am unable to delete them, it shows they are opened in another program cant be deleted

When i sbt run ,i got an error like this ?

otSpot™ 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
[info] Loading project definition from C:\Users\sol\myProject\project
[info] Loading settings from build.sbt …
[info] Set current project to hw (in build file:/C:/Users/sol/myProject/)
[info] Updating …
[info] Done updating.
[info] Packaging C:\Users\sol\myProject\target\scala-2.11\hw_2.11-1.0.jar …
[info] Done packaging.
[error] java.lang.RuntimeException: No main class detected.
[error] at scala.sys.package$.error(package.scala:27)
[error] at sbt.Defaults$.$anonfun$bgRunTask$4(Defaults.scala:1166)
[error] at scala.Option.getOrElse(Option.scala:121)
[error] at sbt.Defaults$.$anonfun$bgRunTask$3(Defaults.scala:1166)
[error] at scala.Function1.$anonfun$compose$1(Function1.scala:44)
[error] at sbt.internal.util.$tilde$greater.$anonfun$$u2219$1(TypeFunctions.scala:39)
[error] at sbt.std.Transform$$anon$4.work(System.scala:66)
[error] at sbt.Execute.$anonfun$submit$2(Execute.scala:262)
[error] at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:16)
[error] at sbt.Execute.work(Execute.scala:271)
[error] at sbt.Execute.$anonfun$submit$1(Execute.scala:262)
[error] at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:174)
[error] at sbt.CompletionService$$anon$2.call(CompletionService.scala:36)
[error] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[error] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[error] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[error] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[error] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[error] at java.lang.Thread.run(Thread.java:748)
[error] (Compile / bgRun) No main class detected.
[error] Total time: 1 s, completed Jul 15, 2018 8:10:17 PM


#3

somehow got it , i mentioned the path of simple-scala program in eclipse and then used sbt run