edrevo opened a new issue #472: URL: https://github.com/apache/arrow-datafusion/issues/472
The task and job status we save in the scheduler state is currently lacking. See: https://github.com/apache/arrow-datafusion/blob/16011120a1b73798049c5be49f9548b00f8a0a00/ballista/rust/core/proto/ballista.proto#L669-L680 And https://github.com/apache/arrow-datafusion/blob/16011120a1b73798049c5be49f9548b00f8a0a00/ballista/rust/core/proto/ballista.proto#L614-L624 The job status should include: - Start time for the job (the moment it was queued) - Finish time for the job (for the completed state) - Number of pending/running/completed/failed tasks and stages (for the running state) The task status should include: - Start time for the task - Finish time for the task (for the completed state) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
