EmmyMiao87 opened a new pull request #368: Add a frontend interface for committing RoutineLoadTask URL: https://github.com/apache/incubator-doris/pull/368 1. add a needSchedulerTasksQueue in LoadManager: the RoutineLoadTaskScheduler will poll task from this queue and schedule task. 2. add a frontend interface named rlTaskCommit: commit txn, update offset and renew a task for the same partitions 3. add a extra property in transaction state: in rlTaskCommit,the extra property which looks like {"job_id": xxx, "progress": xxx} When fe initialize routine load job meta from logs, all of txn state which related to routine load job will be used for initializing progress of job.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
