[
https://issues.apache.org/jira/browse/AIRFLOW-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882824#comment-16882824
]
ASF GitHub Bot commented on AIRFLOW-4906:
-----------------------------------------
ashb commented on pull request #5542: [AIRFLOW-4906] Improve debugging for the
SparkSubmitHook
URL: https://github.com/apache/airflow/pull/5542
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Improve debugging for the SparkSubmitHook
> -----------------------------------------
>
> Key: AIRFLOW-4906
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4906
> Project: Apache Airflow
> Issue Type: Improvement
> Components: hooks
> Affects Versions: 1.10.3
> Reporter: Fokko Driesprong
> Assignee: Fokko Driesprong
> Priority: Major
> Fix For: 2.0.0
>
>
> Currently, the output of the spark-submit command is not being sent to the
> logs. This makes debugging of the k8s jobs rather hard. For example, if you
> make a typo, you only will get the exit code which is non-descriptive.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)