'crime' data does not finish copying


I was trying to copy the ‘crime’ data from local to hdfs location under my username using copyFromLocal. It was taking too long. I waited for 1hr and then cancelled the copy operation.

Now, I am trying to copy the same from hdfs location /public/crime into my hdfs home folder. It has been 15mins, still the copy is going on.

Can you please let me know the expected time to copy 4.3GB dump,

  1. from local to hdfs location
  2. from one hdfs location to another hdfs location

Subhasis Mukherjee



Time depends on the file size.