Input path error

Big Data Apache Spark
#1

Though a file exists in HDFS, I am getting an input path error in Spark

#2

Pasted image1366×768 52.5 KB

#3

Pasted image1339×539 81.5 KB

#4

@suchintakp5 - By looking at screen print your file present in local NOT in HDFS try with /home/suchintakp5/error_log.txt

#5

@gnanaprakasam I am not getting you

#6

@suchintakp5
First check you have error_log.txt in HDFS using below command (ls will list the file under /home/suchintakp5 only)
hadoop fs -ls /user/suchintakp5

Copy the data from local to HDFS using
hadoop fs -put /home/suchintakp5/error_log.txt /user/suchintakp5/error_log.txt

2 Likes
#7

@suchintakp5 - If the above input resolves the issue then could you please close this ?

#8

Your input file is not in hdfs.move it to your hdfs and try