wombatu-kun commented on code in PR #12772:
URL: https://github.com/apache/hudi/pull/12772#discussion_r2120054064
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/RDDBucketIndexPartitioner.java:
##########
@@ -84,8 +85,8 @@ private JavaRDD<HoodieRecord<T>>
doPartitionAndCustomColumnSort(JavaRDD<HoodieRe
final String[] sortColumns = sortColumnNames;
final SerializableSchema schema = new
SerializableSchema(HoodieAvroUtils.addMetadataFields((new
Schema.Parser().parse(table.getConfig().getSchema()))));
Comparator<HoodieRecord<T>> comparator = (Comparator<HoodieRecord<T>> &
Serializable) (t1, t2) -> {
- FlatLists.ComparableList obj1 =
FlatLists.ofComparableArray(t1.getColumnValues(schema.get(), sortColumns,
consistentLogicalTimestampEnabled));
- FlatLists.ComparableList obj2 =
FlatLists.ofComparableArray(t2.getColumnValues(schema.get(), sortColumns,
consistentLogicalTimestampEnabled));
+ FlatLists.ComparableList obj1 =
SparkAdapterSupport$.MODULE$.sparkAdapter().createComparableList(t1.getColumnValues(schema.get(),
sortColumns, consistentLogicalTimestampEnabled));
+ FlatLists.ComparableList obj2 =
SparkAdapterSupport$.MODULE$.sparkAdapter().createComparableList(t2.getColumnValues(schema.get(),
sortColumns, consistentLogicalTimestampEnabled));
Review Comment:
Reverted to FlatLists.ofComparableArray
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
