Hello all, In DefaultSorter, for the OrderedPartitioned case, is the inclusion of empty partition headers and segments in the file.out.index and file.out needed?
In the Unordered case, we prune out the empty partitions in the writer and it might be worth doing the same in the Ordered case unless this behavior was intentional. Would appreciate some comments on this. Thanks and Regards, Kuhu
