Spark 2 access issue in labs

apache-spark

#1

HI,

I am not able to lunch the spark2 and getting the below mentioned error message .

I have set the export SPARK_MAJOR_VERSION=2 as well

[ramesh1984@gw02 bin]$ /usr/hdp/current/spark2-client/bin/spark-submit --master yarn --conf spark.ui.port=56127
Exception in thread “main” java.lang.IllegalArgumentException: Missing application resource.
at org.apache.spark.launcher.CommandBuilderUtils.checkArgument(CommandBuilderUtils.java:253)
at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitArgs(SparkSubmitCommandBuilder.java:161)
at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitCommand(SparkSubmitCommandBuilder.java:275)
at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:152)
at org.apache.spark.launcher.Main.main(Main.java:87)

Regards,
Ramesh


#2

Hi @ramesh1984 To Launch spark2 in labs refer this below discuss.


#3

I think you have mixed up spark-shell and spark-submit.


#4

It is working fine now. Thanks !!


#5