[
https://issues.apache.org/jira/browse/PIG-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated PIG-3930:
-------------------------------
Resolution: Fixed
Fix Version/s: 0.13.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thank you Gera!
> "java.io.IOException: Cannot initialize Cluster" in local mode with
> hadoopversion=23 dependencies
> -------------------------------------------------------------------------------------------------
>
> Key: PIG-3930
> URL: https://issues.apache.org/jira/browse/PIG-3930
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.12.0
> Reporter: Gera Shegalov
> Assignee: Gera Shegalov
> Priority: Critical
> Fix For: 0.13.0
>
> Attachments: PIG-3930.v01.patch
>
>
> Steps to reproduce with script wc.pig
> {code}
> A = load 'README.txt';
> B = foreach A generate flatten(TOKENIZE((chararray)$0)) as word;
> C = group B by word;
> D = foreach C generate COUNT(B), group;
> store D into 'wc.out';
> {code}
> # $ cd workspace/pig-trunk
> # $ ant clean -Dhadoopversion=23 jar
> # $ bin/pig -x local ~/wc.pig
> The problem is that in the dependency
> {{./build/ivy/lib/Pig/hadoop-mapreduce-client-common-2.0.3-alpha.jar}} the
> file
> {{META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider}}
> lacks the entry {{org.apache.hadoop.mapred.LocalClientProtocolProvider}}.
> When the dependency is folded into fat pig.jar
> {{src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider}}
> is overwritten.
> This can be fixed by using duplicate="preserve" in ant jar task.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
