Apache Pig - Join two datasets using Pig - 02 Inner Join- ERROR 2017: Internal error creating job configuration


#1

Hi,

With respect to the video “Apache Pig - Join two datasets using Pig - 02 Inner Join” under the HDPCD - No java playlist, when I practice the below commands in Apache Pig in Hortonworks Sandbox, I’m getting the error:

ERROR 2017: Internal error creating job configuration.
2018-04-05 03:55:21,490 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 20 17: Internal error creating job configuration.
Details at logfile: /root/pig_1522897568459.log

grunt> orderitemsgroupall = GROUP order_items ALL ;

grunt> orderitemscount = FOREACH orderitemsgroupall GENERATE COUNT_STAR(order_items) AS cnt;

grunt> ordersjoingrouped = GROUP ordersjoin ALL;

grunt> ordersjoincount = FOREACH ordersjoingrouped GENERATE COUNT_STAR(ordersjoin) AS cnt;

I’m getting the error “ERROR 2017: Internal error creating job configuration.” when I run the below commands:

grunt> ILLUSTRATE ordersjoin;

grunt> DUMP orderitemscount ;

grunt> DUMP ordersjoincount;

Could someone help me resolve this error? Is anything wrong with the Sandbox itself?

Thanks in advance!

Log :

Pig Stack Trace
---------------
ERROR 1003: Unable to find an operator for alias orderjoinlimit

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1003: Unable to find a
n operator for alias orderjoinlimit
_ at org.apache.pig.PigServer$Graph.buildPlan(PigServer.java:1628)_
_ at org.apache.pig.PigServer.storeEx(PigServer.java:1113)_
_ at org.apache.pig.PigServer.store(PigServer.java:1081)_
_ at org.apache.pig.PigServer.openIterator(PigServer.java:994)_
_ at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:7_
45)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript_
Parser.java:376)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:229)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:204)
_ at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)_
_ at org.apache.pig.Main.run(Main.java:564)_
_ at org.apache.pig.Main.main(Main.java:175)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl._
java:62)
_ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces_
sorImpl.java:43)
_ at java.lang.reflect.Method.invoke(Method.java:498)_
_ at org.apache.hadoop.util.RunJar.run(RunJar.java:233)_
_ at org.apache.hadoop.util.RunJar.main(RunJar.java:148)_
================================================================================
Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.

java.io.IOException: Exception
_ at org.apache.pig.PigServer.getExamples(PigServer.java:1395)_
_ at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser._
java:803)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigS_
criptParser.java:818)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript_
Parser.java:385)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:229)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:204)
_ at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)_
_ at org.apache.pig.Main.run(Main.java:564)_
_ at org.apache.pig.Main.main(Main.java:175)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl._
java:62)
_ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces_
sorImpl.java:43)
_ at java.lang.reflect.Method.invoke(Method.java:498)_
_ at org.apache.hadoop.util.RunJar.run(RunJar.java:233)_
_ at org.apache.hadoop.util.RunJar.main(RunJar.java:148)_
Caused by: java.lang.RuntimeException: org.apache.pig.backend.hadoop.executionen
gine.JobCreationException: ERROR 2017: Internal error creating job configuration
.
_ at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java_
:159)
_ at org.apache.pig.PigServer.getExamples(PigServer.java:1389)_
_ … 14 more_
Caused by: org.apache.pig.backend.hadoop.executionengine.JobCreationException: E
RROR 2017: Internal error creating job configuration.
_ at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobContr_
olCompiler.compile(JobControlCompiler.java:332)
_ at org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSi_
mulator.java:114)
_ at org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257_
)
_ at org.apache.pig.pen.ExampleGenerator.readBaseData(ExampleGenerator.jav_
a:221)
_ at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java_
:153)
_ … 15 more_
Caused by: java.lang.ClassCastException: org.apache.pig.tools.pigstats.tez.TezSc
riptState cannot be cast to org.apache.pig.tools.pigstats.mapreduce.MRScriptStat
e
_ at org.apache.pig.tools.pigstats.mapreduce.MRScriptState.get(MRScriptSta_
te.java:67)
_ at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobContr_
olCompiler.getJob(JobControlCompiler.java:513)
_ at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobContr_
olCompiler.compile(JobControlCompiler.java:323)
_ … 19 more_
================================================================================
Pig Stack Trace
---------------
ERROR 1200: <line 9, column 44> Syntax error, unexpected symbol at or near 'COU
NT_STAR’

Failed to parse: <line 9, column 44> Syntax error, unexpected symbol at or near
_ ‘COUNT_STAR’_
_ at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:_
244)
_ at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:_
182)
_ at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1791)_
_ at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1764)_
_ at org.apache.pig.PigServer.registerQuery(PigServer.java:707)_
_ at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:10_
73)
_ at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript_
Parser.java:505)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:229)
_ at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j_
ava:204)
_ at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)_
_ at org.apache.pig.Main.run(Main.java:564)_
_ at org.apache.pig.Main.main(Main.java:175)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)_
_ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl._
java:62)
_ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces_
sorImpl.java:43)
_ at java.lang.reflect.Method.invoke(Method.java:498)_
_ at org.apache.hadoop.util.RunJar.run(RunJar.java:233)_
_ at org.apache.hadoop.util.RunJar.main(RunJar.java:148)_
================================================================================
Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.