Add folders with files to Hadoop Cluster

sqoop

#1

Hi,

I have large no of files. Data is NASDAQ Stock data from 1999 till date. I have data in folders. Ex: 1999 Folders will have months and month folder will have files.
So I will have 25 Years folders, and in each year folder I have 12 months folders and in each month I will have files.
How do I load these files into Hadoop in a single shot and also, is there a way to load all the files into one folder in Hadoop/Spark.

Thanks
RK


#2

The files inside are in CSV Format


#3

@Radhakrishna
In ambari go to Files view.
under user
under radhakrishna (username)
You can add new folder and upload the files.

Refer below screenshot for better understanding.


#4

Thanks Chandan.
I want to use programming instead of manual work.


#5