ephraimbuddy commented on pull request #16394:
URL: https://github.com/apache/airflow/pull/16394#issuecomment-867829654
> @ephraimbuddy - running it here. There are few small things I corrected
(let's see if it helps):
>
> * I moved the common functions to _parallel.sh (and prefixed with
`parallell::`)
> * I renamed the common functions to __helm__
> * I added the `>"${JOB_LOG}" 2>&1` redirection (that was the actual
culprit for the failure you had - the output was simply printed directly to
stdout for parallel jobs, rather than redirected to a separate log per
parallell job. So when we tried to print the output after all jobs were
finished, the JOB_LOG file was missing (and then it failed).
Cool!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
