houbb opened a new issue, #6236: URL: https://github.com/apache/seatunnel/issues/6236
### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description The latest in learning seaTunnel, I'm very grateful to the author for providing such a powerful feature. I have a question and, after reading the official documentation and GitHub issues, I haven't found a particularly good solution. Version: v2.3.3 Engine: Default seaTunnel engine Scenario: When wanting to execute a task at regular intervals, such as sourcing data from an Elasticsearch database every 5 minutes and processing the recently collected data into a time-series database, how should this be implemented? Expectation: The ability to specify the time interval for scheduled execution. Ideally, this should be supported by all sources, and incremental queries based on specified conditions. Considered Approach: Using `job.mode=batch` and then triggering this task at scheduled intervals. However, the question arises: who should trigger the task? It should ideally be part of the component's capabilities. Could you please provide some clarification on this? Thank you very much. ------------------------------------------------------------------------ 最新在学习 seaTunnel,非常感谢作者提供这么强大的功能。 有一个疑问,看完官方文档+github issues 没找到特别好的解决方式。 版本:v2.3.3 引擎:默认 seaTunnel 引擎 场景:希望定时去执行一个任务的时候,应该如何实现呢?比如 source 是 ES 数据库,5min 想执行一次最近 5min 的符合条件的数据,落入到时序数据库。 期望:可以指定定时调度的时间间隔。按理说所有的 source 都应该支持。按照条件增量查询。 考虑到的方式:job.mode=batch,然后定时触发这个任务。但是任务应该由谁触发呢?应该是组件能力的一部分,麻烦解惑。多谢 ### Usage Scenario version: v2.3.3 engine: default seatunnel engine source: connector-elasticsearch source ---------------------------------------- 版本:v2.3.3 引擎:默认 seaTunnel 引擎 source 源:connector-elasticsearch source ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
