Order by desc does not work with more than one reducer
------------------------------------------------------
Key: PIG-441
URL: https://issues.apache.org/jira/browse/PIG-441
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: types_branch
Reporter: Alan Gates
Assignee: Alan Gates
Fix For: types_branch
Order by with desc works if you use a single reducer. But with more than one
reducer the partitions are not correctly constructed. The SortParitioner uses
the object comparators, not the raw the comparators. The object comparators
have no concept of order by descending. So they build the partitions for
ascending order. The end result is data sorted descending within the partition
but not across partitions.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.