Spark streeming - Flume - spark-streaming-flume-sink jar missing

hi
I am trying to run the flume job.
It uses /usr/hdp/2.6.5.0-292 and it is found that bellow jars are missing -
spark-streaming_2.10-1.6.2.jar
spark-streaming-flume-sink_2.10-1.6.2.jar
spark-streaming-flume_2.10-1.6.2.jar

under /usr/hdp/2.6.5.0-292/flume/lib/

I tried to copy from the other hdp version like this
cp /usr/hdp/2.5.0.0-1245/flume/lib/spark-streaming-flume-sink_2.10-1.6.2.jar /usr/hdp/2.6.5.0-292/flume/lib/

please copy the file.


Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster