[ 
https://issues.apache.org/jira/browse/OOZIE-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568570#comment-15568570
 ] 

Abhishek Bafna commented on OOZIE-2710:
---------------------------------------

Checked all the jars in {{pig}}, {{hive}} and {{hcatalog}}, none of them 
contains the {{HCatLoader}} class. Command used is:

{noformat}
for i in *.jar; do jar -tvf "$i" | grep -Hsi HCatLoader && echo "$i"; done
{noformat}

The class is available in the {{hive-hcatalog-pig-adapter}} module. Added the 
same into oozie pig share lib module, excluded some of the hive-shims and 
curator jars.

> Oozie HCatalog example workflow fails
> -------------------------------------
>
>                 Key: OOZIE-2710
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2710
>             Project: Oozie
>          Issue Type: Bug
>          Components: core
>            Reporter: Abhishek Bafna
>            Assignee: Abhishek Bafna
>            Priority: Blocker
>             Fix For: 4.3.0
>
>
> Oozie HCatalog example workflow fails with the below exception:
> {noformat}
> 2016-10-12 10:33:37,260 [uber-SubtaskRunner] ERROR org.apache.pig.PigServer  
> - exception during parsing: Error during parsing. Could not resolve 
> org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
> Failed to parse: Pig script failed to parse: 
> <file id.pig, line 18, column 33> pig script failed to validate: 
> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not 
> resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
>       at 
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
>       at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1819)
>       at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1527)
>       at org.apache.pig.PigServer.parseAndBuild(PigServer.java:460)
>       at org.apache.pig.PigServer.executeBatch(PigServer.java:485)
>       at org.apache.pig.PigServer.executeBatch(PigServer.java:471)
>       at 
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:172)
>       at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:235)
>       at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:206)
>       at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>       at org.apache.pig.Main.run(Main.java:501)
>       at org.apache.pig.PigRunner.run(PigRunner.java:49)
>       at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:290)
>       at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:233)
>       at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:60)
>       at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:73)
>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>       at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>       at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>       at java.lang.reflect.Method.invoke(Method.java:497)
>       at 
> org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:232)
>       at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
>       at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
>       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
>       at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:380)
>       at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:301)
>       at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
>       at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
>       at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>       at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>       at java.lang.Thread.run(Thread.java:745)
> Caused by: 
> <file id.pig, line 18, column 33> pig script failed to validate: 
> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not 
> resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
>       at 
> org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1339)
>       at 
> org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1324)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:5184)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3515)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
>       at 
> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
>       at 
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
>       ... 32 more
> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: 
> Could not resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, 
> java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]
>       at org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:671)
>       at 
> org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1336)
>       ... 40 more
> {noformat}
> job.properties file:
> {noformat}
> nameNode=hdfs://host:8020
> jobTracker=host:8050
> queueName=default
> examplesRoot=examples
> oozie.use.system.libpath=true
> oozie.action.sharelib.for.pig=pig,hive,hcatalog
> oozie.coord.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/hcatalog
> hcatNode=hcat://host:9083
> db=default
> table=invites
> start=2010-01-01T01:00Z
> end=2010-01-01T01:20Z
> workflowAppUri=${nameNode}/user/${user.name}/${examplesRoot}/apps/hcatalog
> dataOut=2011-01-01
> outputtable=oozie
> region=usa
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to