liyunzhang_intel created PIG-4438:
-------------------------------------
Summary: Can not work when in "limit after sort" situation in
spark mode
Key: PIG-4438
URL: https://issues.apache.org/jira/browse/PIG-4438
Project: Pig
Issue Type: Bug
Components: spark
Reporter: liyunzhang_intel
Assignee: liyunzhang_intel
when pig script executes "order" before "limit" in spark mode, the results will
be wrong.
cat testlimit.txt
1 orange
3 coconut
5 grape
6 pear
2 apple
4 mango
testlimit.pig:
a = load './testlimit.txt' as (x:int, y:chararray);
b = order a by x;
c = limit b 1;
store c into './testlimit.out';
the result:
1 orange
2 apple
3 coconut
4 mango
5 grape
6 pear
the correct result should be:
1 orange
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
