houbb opened a new issue, #6236:
URL: https://github.com/apache/seatunnel/issues/6236

   ### Search before asking
   
   - [X] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   The latest in learning seaTunnel, I'm very grateful to the author for 
providing such a powerful feature. I have a question and, after reading the 
official documentation and GitHub issues, I haven't found a particularly good 
solution.
   
   Version: v2.3.3
   
   Engine: Default seaTunnel engine
   
   Scenario: When wanting to execute a task at regular intervals, such as 
sourcing data from an Elasticsearch database every 5 minutes and processing the 
recently collected data into a time-series database, how should this be 
implemented?
   
   Expectation: The ability to specify the time interval for scheduled 
execution. Ideally, this should be supported by all sources, and incremental 
queries based on specified conditions.
   
   Considered Approach: Using `job.mode=batch` and then triggering this task at 
scheduled intervals. However, the question arises: who should trigger the task? 
It should ideally be part of the component's capabilities. Could you please 
provide some clarification on this? Thank you very much.
   
   ------------------------------------------------------------------------
   
   最新在学习 seaTunnel,非常感谢作者提供这么强大的功能。
   
   有一个疑问,看完官方文档+github issues 没找到特别好的解决方式。
   
   版本:v2.3.3
   
   引擎:默认 seaTunnel 引擎
   
   场景:希望定时去执行一个任务的时候,应该如何实现呢?比如 source 是 ES 数据库,5min 想执行一次最近 5min 
的符合条件的数据,落入到时序数据库。
   
   期望:可以指定定时调度的时间间隔。按理说所有的 source 都应该支持。按照条件增量查询。
   
   考虑到的方式:job.mode=batch,然后定时触发这个任务。但是任务应该由谁触发呢?应该是组件能力的一部分,麻烦解惑。多谢
   
   ### Usage Scenario
   
   version: v2.3.3
   engine: default seatunnel engine
   source: connector-elasticsearch source
   
   ----------------------------------------
   
   版本:v2.3.3
   引擎:默认 seaTunnel 引擎
   source 源:connector-elasticsearch source
   
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to