[
https://issues.apache.org/jira/browse/PIG-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shenxianqiang updated PIG-5057:
-------------------------------
Status: Patch Available (was: Open)
In getValueTuple function:
copy.set(i, val.get(valIndex));
There is no comparison the size of array val.
> IndexOutOfBoundsException when pig reducer processOnePackageOutput
> ------------------------------------------------------------------
>
> Key: PIG-5057
> URL: https://issues.apache.org/jira/browse/PIG-5057
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.15.0, 0.14.0
> Environment: pig-0.14/pig-0.15 cdh5.3.2
> Reporter: shenxianqiang
> Priority: Minor
> Attachments: PIG-5057.patch
>
>
> When runing a pig job,the reducer throw out of bands exception,which leads
> the job failed.
> {quote}
> 2016-11-14 15:31:04,752 WARN [main] org.apache.hadoop.io.compress.LzoCodec:
> org.apache.hadoop.io.compress.LzoCodec is deprecated. You should use
> com.hadoop.compression.lzo.LzoCodec instead to generate LZO compressed data.
> 2016-11-14 15:32:08,300 WARN [main] org.apache.hadoop.mapred.YarnChild:
> Exception running child : java.lang.IndexOutOfBoundsException: Index: 1,
> Size: 1
> at java.util.ArrayList.rangeCheck(ArrayList.java:635)
> at java.util.ArrayList.get(ArrayList.java:411)
> at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:117)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.Packager.getValueTuple(Packager.java:234)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage$PeekedBag$1.next(POPackage.java:435)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage$PeekedBag$1.next(POPackage.java:408)
> at
> org.apache.pig.data.DefaultAbstractBag.addAll(DefaultAbstractBag.java:151)
> at
> org.apache.pig.data.DefaultAbstractBag.addAll(DefaultAbstractBag.java:137)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.Packager.attachInput(Packager.java:125)
> at
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNextTuple(POPackage.java:283)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:431)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:422)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:269)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
> at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1892)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
