[
https://issues.apache.org/jira/browse/PIG-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636900#comment-13636900
]
Johnny Zhang commented on PIG-3279:
-----------------------------------
Thanks Gianmarco open the jira. The current patch make nested rank syntax
working. My test case is:
data:
{noformat}
John Banking 20000
Jane Banking 35000
Chen Real Estate 30000
Hari Real Estate 22000
Asha Technology 26000
{noformat}
script:
{noformat}
a = load 'input1' as (name:chararray, industry:chararray, income:int);
b = group a by industry;
c = foreach b { d = rank a by income; generate flatten(d); }
describe c;
dump c;
{noformat}
c's schema seems right
{noformat}
c: {d::rank_a: long,d::name: chararray,d::industry: chararray,d::income: int}
{noformat}
however, it has back end exception
{noformat}
3992 [Thread-4] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
java.lang.NullPointerException
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getValueTuple(POPackage.java:330)
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNext(POPackage.java:269)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:413)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:257)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
{noformat}
not quite understand the code here, roughly think the local rearrange key
information has issue, will continue working on it. Thanks.
> Support nested RANK
> -------------------
>
> Key: PIG-3279
> URL: https://issues.apache.org/jira/browse/PIG-3279
> Project: Pig
> Issue Type: Improvement
> Reporter: Gianmarco De Francisci Morales
> Attachments: PIG-3279-1.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
