andygrove opened a new issue, #1998: URL: https://github.com/apache/datafusion-ballista/issues/1998
## Is your feature request related to a problem or challenge? The executor logs `Execute task : [...]` when a task starts and `Finished task : [...]` when it ends, but neither line reports how long the task took. To find a slow task today you have to correlate the two log lines by timestamp, or inspect the task-status reports sent back to the scheduler. Per-task duration is the single most useful number when eyeballing executor logs for skew or long-pole stages, and it is not there. ## Describe the solution you'd like Include the elapsed execution time in the `Finished task` log message, e.g.: ``` Finished task : [job/stage/partition] in 2.31s ``` This applies to both task-dispatch paths — the `executor_server` push path and the `execution_loop` pull path. ## Additional context Small, self-contained logging improvement; no behavior or API change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
