Hi, Au_Miner
 Thank you for your reply. I will address each question one by one.
>1、当前是计划重新开发一套flink-extension模块以连接native-engine吗,据我所了解目前auron的jniBridge与spark-memory关联较为密切,需要在native-engine中对spark-memory进行解藕。是否有计划将spark-extension中的部分逻辑进行拆分,以实现二者的共享。
Yes, we have already introduced the Flink module into the Auron repository.  In 
issue #1263 [1], we have completed the decoupling of some basic 
functionalities. 
Regarding the spark-memory related matters you mentioned, my understanding is 
limited to the on-heap spill component and its connection to Spark. We will 
continue to advance the decoupling efforts, which will be a long-term process.


>2、Calc Operator的native实现,是否有计划在前后添加r2c,c2r operator,这块的添加逻辑是否也有计划在flink的改造中添加接口
As Native operator coverage increases, standalone row/column transformation 
operators offer advantages in scenarios where multiple Native operators can be 
chained together. 
Only for Calc operator, embedding row/column transformations may prove more 
convenient. Of course, this approach is open for discussion.


>3、当前对Flink的版本有选择吗,Flink的改造是否有接口的计划表(据我所了解需要在Phyiscal/ExecNode、Rule、Processor、OperatorChain等方面需要考虑)
> 
We plan to start with Flink version 1.18. Among the companies I know of, the 
primary versions are 1.17 and 1.18.
Currently, this initiative only involves the Auron community. Improvements for 
the Flink community will be initiated in the future, with no confirmed timeline 
at this time.


4、回撤类型、水位线、Checkpoint、时间服务、状态后端的支持可能是后续阶段的重点,是否有计划在native-engine中支持。
For Phase 1, stateless operators, watermarks, and checkpoints will be 
supported. Retract Message, TimeService, and state backends will not be 
supported; these will be supported in Phase 2.


I hope this answers your question. I look forward to receiving more feedback.



--

Best regards,
Mang Zhang



在 2025-11-28 21:36:13,"Au_Miner" <[email protected]> 写道:
>关于Flink SQL + Auron Collaboration有一些想法,
>
>
>1、当前是计划重新开发一套flink-extension模块以连接native-engine吗,据我所了解目前auron的jniBridge与spark-memory关联较为密切,需要在native-engine中对spark-memory进行解藕。是否有计划将spark-extension中的部分逻辑进行拆分,以实现二者的共享。
>
>
>2、Calc Operator的native实现,是否有计划在前后添加r2c,c2r operator,这块的添加逻辑是否也有计划在flink的改造中添加接口
>3、当前对Flink的版本有选择吗,Flink的改造是否有接口的计划表(据我所了解需要在Phyiscal/ExecNode、Rule、Processor、OperatorChain等方面需要考虑)
> 4、回撤类型、水位线、Checkpoint、时间服务、状态后端的支持可能是后续阶段的重点,是否有计划在native-engine中支持。

Reply via email to