[
https://issues.apache.org/jira/browse/PIG-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477399#comment-13477399
]
Koji Noguchi commented on PIG-2975:
-----------------------------------
bq. (For larger bytearray whose size does not fit in 1 byte(TINYBYTEARRAY),
this compare method would take part of the header as content hurting the order
but not the uniqueness.)
This can be confirmed without PIG-2862. Using pig-0.10, we can see that
bytearray-order is messed up.
{noformat}
$ cat orderbig.txt
1
3
2222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222
2
55
222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222
4
33
$ cat orderbig.pig
a = load 'orderbig.txt' as (num:bytearray);
b = order a by num;
dump b;
$ pig -x local orderbig.pig
...
(222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222)
(1)
(2)
(2222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222)
(3)
(33)
(4)
(55)
{noformat}
> TestTypedMap.testOrderBy failing with incorrect result
> -------------------------------------------------------
>
> Key: PIG-2975
> URL: https://issues.apache.org/jira/browse/PIG-2975
> Project: Pig
> Issue Type: Sub-task
> Affects Versions: 0.11
> Reporter: Koji Noguchi
> Priority: Blocker
> Fix For: 0.11
>
>
> Looked at
> {noformat}
> junit.framework.AssertionFailedError
> at org.apache.pig.test.TestTypedMap.testOrderBy(TestTypedMap.java:352)
> {noformat}
> This looks like a valid test case failing with incorrect result.
> {noformat}
> % cat test/orderby.txt
> [key#1,key9#23]
> [key#3,key3#2]
> [key#22]
> % cat test/orderby.pig
> a = load 'test/orderby.txt' as (m:[]);
> b = foreach a generate m#'key' as b0;
> dump b;
> c = order b by b0;
> dump c;
> % java ... org.apache.pig.Main -x local test/orderby.pig
> [dump b]
> (1)
> (3)
> (22)
> ...
> [dump c]
> (1)
> (1)
> (22)
> %
> where did the '(3)' go?
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
