Spark-Exam Questions


#1

Hi Team,

Can any one please help me how could I run Jar files in test?

while I was attempting first time,I could nt be able to do spark-submit command as my jar was placed in the desktop question folder.

How should I take it from to local path?Any suggestion appreciated

Please help me whoever cleared the certifications.

Thanks in advance.


Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster


#2

spark-submit --class class_name jar_location.

jar_location should be fully qualified jar_location. eg: /home/username/Desktop/abc.jar
If the jar need is in your local machine, then transfer the jar to the labs using WinSCP ( if your using windows) or SCP command (if your using linux mcahine)


#3

Hi Pradeep,
Thanks much for your response. In the exam they were given jar file in the desktop ( ubantu machine)
I needs to move that .jar file to hadoop cluster local path.
Can you give me winscp command to transfer the files or winscp tool will available to move the files?
Please help me.


#4

If the jar need is in your local machine, then transfer the jar to the labs using WinSCP ( if your using windows) or SCP command (if your using linux mcahine)


#5

@Karthikb.127, if you need to copy jar file from ubuntu to hadoop gateway or edge local path then you need to do so using scp. WinScp is windows to remote machines.