Paul Rogers created DRILL-6080:
----------------------------------
Summary: Sort incorrectly limits batch size to 65535 records
rather than 65536
Key: DRILL-6080
URL: https://issues.apache.org/jira/browse/DRILL-6080
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.12.0
Reporter: Paul Rogers
Assignee: Paul Rogers
Priority: Minor
Fix For: 1.13.0
Drill places an upper limit on the number of rows in a batch of 64K. That is
65,536 decimal. When we index records, the indexes run from 0 to 64K-1 or 0 to
65,535.
The sort code incorrectly uses {{Character.MAX_VALUE}} as the maximum row
count. So, if an incoming batch uses the full 64K size, sort ends up splitting
batches unnecessarily.
The fix is to instead use the correct constant `ValueVector.MAX_ROW_COUNT`.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)