Pig 0.11 has more dependencies than pig-0.9 and those need to be included
as dependencies in the oozie pom to work.
branch 3.3:
Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error. org/codehaus/jackson/map/util/LRUMap
java.lang.NoClassDefFoundError: org/codehaus/jackson/map/util/LRUMap
at org.apache.pig.builtin.JsonMetadata.<init>(JsonMetadata.java:75)
at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:471)
Running on branch-4.0, jackson-core-asl and mapper-asl jars are there
but automaton-1.11-8.jar is not available.
java.lang.NoClassDefFoundError: dk/brics/automaton/Automaton
at
org.apache.pig.impl.util.JarManager$DefaultPigPackages.<clinit>(JarManager.java:99)
at
org.apache.pig.impl.util.JarManager.createJar(JarManager.java:136)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:517)
You can find why the pig launcher job failed by checking stdout or stderr
files.
Just run the test as mvn clean package -Dtest=TestPigActionExecutor and do
a find . -name stdout.
The pig pom.xml is not proper and does not include the correct
dependencies (https://issues.apache.org/jira/browse/PIG-3189), so they are
not pulled automatically as transitive dependencies.
Regards,
Rohini
On Wed, Apr 24, 2013 at 11:34 AM, Roman Shaposhnik <[email protected]> wrote:
> On Wed, Apr 24, 2013 at 11:30 AM, Renata Ghisloti Duarte de Souza
> <[email protected]> wrote:
> >
> > On Wed, Apr 24, 2013 at 3:26 PM, Roman Shaposhnik <[email protected]>
> wrote:
> >
> >> On Wed, Apr 24, 2013 at 11:16 AM, Renata Ghisloti Duarte de Souza
> >> <[email protected]> wrote:
> >> > Does anyone knows how to fix this problem?
> >>
> >> This looks like a problem with unit tests.
> >>
> >> > Is it of interest of the Oozie community to support new version of
> Pig?
> >>
> >> Pig 0.11 is actually fully supported by Oozie on Hadoop 2.0.4-alpha.
> >> We've been very successful with it in Apache Bigtop.
> >>
> >
> > Humm ok.
> >
> > But, is it possible to build Oozie with Pig 0.11 and Hadoop 1.x ?
>
> Good question. I know a few folks are working on a release of Bigtop 0.3.1
> that is supposed to be based on Hadoop 1.x. You may want to ask on
> the BT mailing list what the status there is.
>
> Thanks,
> Roman.
>
