Error while DUMP ing a relation in Pig


#1

Hello team,

I am facing an error in Pig while dumping the data as shown below. Can you please advise what is wrong ?

–Step 1: Loading data into a relation from csv file.

grunt> groceries = load ‘/user/sbhupathiraju86/groceries.csv’ using PigStorage(’,’) as (id:chararray, city:chararray, product:chararray, purdate:chararray, qty:int);

– step 2: Dump data from the relation.
grunt> dump groceries;

– Output of dump relation.

2019-01-03 07:02:41,779 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN
2019-01-03 07:02:41,817 [main] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set… will not generate code.
2019-01-03 07:02:41,817 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[ConstantCalculator, LoadTypeCastInserter, PredicatePushdownOptimizer, StreamTypeCastIn
serter], RULES_DISABLED=[AddForEach, ColumnMapKeyPrune, GroupByConstParallelSetter, LimitOptimizer, MergeFilter, MergeForEach, PartitionFilterOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter]
}
2019-01-03 07:02:41,857 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher - Tez staging directory is /tmp/sbhupathiraju86/staging and resources directory is /tmp/temp-1973978431
2019-01-03 07:02:41,858 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler - File concatenation threshold: 100 optimistic? false
2019-01-03 07:02:41,884 [main] INFO org.apache.pig.builtin.PigStorage - Using PigTextInputFormat
2019-01-03 07:02:41,885 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2019-01-03 07:02:41,885 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
2019-01-03 07:02:41,887 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 1
2019-01-03 07:02:41,898 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: joda-time-2.9.4.jar
2019-01-03 07:02:41,898 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: antlr-runtime-3.4.jar
2019-01-03 07:02:41,898 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: pig-0.16.0.2.6.5.0-292-core-h2.jar
2019-01-03 07:02:41,898 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: automaton-1.11-8.jar
2019-01-03 07:02:41,969 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder - For vertex - scope-63: parallelism=1, memory=2048, java opts=-XX:+PrintGCDetails -verbose:gc -XX:+Pr
intGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB
2019-01-03 07:02:41,969 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder - Processing aliases: groceries
2019-01-03 07:02:41,969 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder - Detailed locations: groceries[4,12],groceries[-1,-1]
2019-01-03 07:02:41,969 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder - Pig features in the vertex:
2019-01-03 07:02:41,996 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2017: Internal error creating job configuration.
Details at logfile: /home/sbhupathiraju86/pig_1546516079837.log


#2

@sbhupathiraju It’s working fine.

output:


#3

it is working fine now with the same set of commands. Not sure the reason for failing earlier. Any idea ?