I am working on Map Reduce project “like the Word count example” with some changes, In my case I have many files to be process if I run the program, I want each map to take one of the files and process it separate from others “I want the output for a file independent from other files output”
I try to use the:
Path filesPath = new Path(“file1.txt,file2.txt,file3.txt”);
MultipleInputs.addInputPath(job, filesPath, TextInputFormat.class, Map.class);
but the output I got is mixing all the files output together, and if a word appear in more than file, it processed once, and that what I don’t want. I want the word count in each file separate.
So how can i use this?
if I put the files in a directory is it will process independent?