Good design, I will work on it in the next few months. In my opinion, the key feature is that amoro will support more flexible procedures like Iceberg sort rewrite job after refactoring this.
nathan ma <majin1...@gmail.com> 于2025年4月17日周四 17:37写道: > Hi community, > > Process framework has been a long story for amoro, some context could be > followed by: > https://github.com/apache/amoro/issues/2596 > > Process framework is aimed to handle truely multi-format and scheduling > extensions, I raised a proposal to discuss details about this feature and > refactoring. And we want to use it to solve the current bottlenecks of AMS: > > > https://docs.google.com/document/d/1pEKneQXI_OIY7EU_XX0xwHeRFG0HHi37bb3SaNucI00/edit?tab=t.0 > > I alse prepared a chinese doc: > > > https://docs.google.com/document/d/16vG8X-qc_IPXco2_rwBHw_Lhw_14_Iv759a8PpIXEpM/edit?tab=t.0 > > Any options or comments could be helpful and make it better, It is > advised to comment on English doc. > > > Thanks > nathan ma >