Flume Spark is not working

Hi ,
I was trying to do flume spark streaming . The spark files were generated without data.

–SPARK HDFS Files:
[prakash63@gw03 lib]$ hadoop fs -ls /user/prakash63/streamingflumedeptcount/cnt-1591582800000
Found 3 items
-rw-r–r-- 2 prakash63 hdfs 0 2020-06-07 22:20 /user/prakash63/streamingflumedeptcount/cnt-1591582800000/_SUCCESS
-rw-r–r-- 2 prakash63 hdfs 0 2020-06-07 22:20 /user/prakash63/streamingflumedeptcount/cnt-1591582800000/part-00000
-rw-r–r-- 2 prakash63 hdfs 0 2020-06-07 22:20 /user/prakash63/streamingflumedeptcount/cnt-1591582800000/part-00001
[prakash63@gw03 lib]$

–Flume HDFS files:

-rw-r–r-- 2 prakash63 hdfs 19743 2020-06-07 22:20 hdfs://nn01.itversity.com:8020/user/prakash63/flume_demo/FlumeDemo.1591582267341.txt
-rw-r–r-- 2 prakash63 hdfs 19950 2020-06-07 22:22 hdfs://nn01.itversity.com:8020/user/prakash63/flume_demo/FlumeDemo.1591582267342.txt
-rw-r–r-- 2 prakash63 hdfs 19841 2020-06-07 22:24 hdfs://nn01.itversity.com:8020/user/prakash63/flume_demo/FlumeDemo.1591582267343.txt
-rw-r–r-- 2 prakash63 hdfs 3721 2020-06-07 22:24 hdfs://nn01.itversity.com:8020/user/prakash63/flume_demo/FlumeDemo.1591582267344.txt
[prakash63@gw03 current]$

Spark Submit Syntax:
spark-submit --master yarn --conf spark.ui.port=12890
–jars “/usr/hdp/2.5.0.0-1245/spark/lib/spark-streaming-flume_2.10-1.6.2.jar,/usr/hdp/2.6.5.0-292/flume/lib/spark-streaming-flume-sink_2.10-1.6.3.jar,/usr/hdp/2.6.5.0-292/flume/lib/flume-ng-sdk-1.5.2.2.6.5.0-292.jar”
/home/prakash63/src/main/python/StreamingFlumeDepartmentCount.py gw03.itversity.com 19900 /user/prakash63/streamingflumedeptcount/cnt

Can someone help on this issue? Is there any issue with the jar file given?

Hi Everyone,

The issue has been resovled. Use the port number 19999