Jonathan Eagles created TEZ-3925:
------------------------------------
Summary: DefaultSorter skips RLE for first spill
Key: TEZ-3925
URL: https://issues.apache.org/jira/browse/TEZ-3925
Project: Apache Tez
Issue Type: Bug
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
If a job is able to fit all keys/values in memory, no sort/spill will be
triggered until the final spill. In this case, since no sort has taken place,
RLE detection is based on state before a sort takes place. The final spill in a
one spill default sort never enables RLE in the final file.out.
https://issues.apache.org/jira/browse/TEZ-3924?focusedCommentId=16460534&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16460534
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)