[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-08 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571989590 > > > > @tooptoop4 if we don't remove the spark check on line 177, how to use this hook to track driver status deployed on

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-07 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571876662 > existing tests for connection added via db/cli needs to work well, I guess the current tests don't support

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-06 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571424197 @tooptoop4 if we don't remove the spark check on line 177, how to use this hook to track driver status deployed on yarn,

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-06 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571429121 @tooptoop4 the tests pass only for the case when the connection information (host, port, conn_type, etc.) are stored in

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-06 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571429121 @tooptoop4 the tests pass only for the case when the connection information (host, port, conn_type, etc.) are stored in

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-06 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571429121 @tooptoop4 the tests pass only for the case when the connection information (host, port, conn_type, etc.) are stored in

[GitHub] [airflow] albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection

2020-01-06 Thread GitBox
albertusk95 edited a comment on issue #7075: [AIRFLOW-6212] SparkSubmitHook resolve connection URL: https://github.com/apache/airflow/pull/7075#issuecomment-571424197 @tooptoop4 if we don't remove the spark check on line 177, how to use this hook to track driver status deployed on yarn,