Re: [I] [SUPPORT] Why HUDI ConsistentBucketClusteringExecutionStrategy not supported by flink engine? [hudi]

Mon, 23 Jun 2025 04:53:22 -0700 


slankka commented on issue #11636:
URL: https://github.com/apache/hudi/issues/11636#issuecomment-2994705149

   According to my colleages and my research, hudi on flink at least 
(0.14~1.0.2) clustering not work, the other actions works fine. And hudi on 
spark all feature works fine.
   
   ## Conclusion
   
   | engine/action | clustering |  compact | clean | archival |
   |---|---|----|----|----|
   | flink | ❌ | ✅ | ✅| ✅|
   |spark|✅|✅|✅|✅|
   
   The clustering execution strategy is supported by Spark but not Flink.
   
   ## Clustering execution strategy
    (configuration likes below do not works with Apache Flink even re-compile 
some modules)
   `hoodie.clustering.execution.strategy.class: 
org.apache.hudi.client.clustering.run.strategy.JavaSortAndSizeExecutionStrategy`
   
![Image](https://github.com/user-attachments/assets/4c46de43-fdca-4630-8d3a-91a5cdaa5c0d)
   
   ## Source code compare
   
   
![Image](https://github.com/user-attachments/assets/5cddf3bc-c495-4503-95c3-67ce26669dd1)
   
   
![Image](https://github.com/user-attachments/assets/67d5d5e1-d8ad-461a-b8dc-3fdbf8659ecb)
   
   
![Image](https://github.com/user-attachments/assets/20443a01-aef2-43b5-8060-3000c6d08895)
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to