Hi Guys, Has anyone faced a similar issue ?
Any help would be really appreciated Regards, Sarath On 06/05/16 09:45, "Sarath Sasidharan" <ssasidha...@bol.com> wrote: >Hi All, > >I was executing the following code in pig when I encountered an array out of >bounds exception inside a nested foreach expression. > >This is the snippet which I used : > > > >generateHistory = foreach (group filterFinalData > by (PrimaryKey > )){ > > offersInDesc = order filterFinalData by PubTime desc; > > latestOffer = limit offersInDesc 1; > > generate flatten(latestOffer); > } > > > > >This is the stack trace which I had in the job tracker logs : > > > org.apache.hadoop.mapred.YarnChild: Exception running child : > java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 > at java.util.ArrayList.rangeCheck(ArrayList.java:653) > at java.util.ArrayList.get(ArrayList.java:429) > at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:117) > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.Packager.getValueTuple(Packager.java:234) > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage$PeekedBag$1.next(POPackage.java:431) > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage$PeekedBag$1.next(POPackage.java:415) > at > org.apache.pig.data.DefaultAbstractBag.addAll(DefaultAbstractBag.java:151) > at > org.apache.pig.data.DefaultAbstractBag.addAll(DefaultAbstractBag.java:137) > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.Packager.attachInput(Packager.java:125) > at > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNextTuple(POPackage.java:290) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:431) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:422) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:269) > at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) > at > org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) > > > >Could someone help me with this ? How could I overcome this issue. > > >Thanks and Regards, > > >Sarath > > >