[jira] [Closed] (AIRFLOW-6566) Replace uses of imp still left with importlib.

2020-01-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta closed AIRFLOW-6566. --- Resolution: Duplicate > Replace uses of imp still left with importlib. >

[GitHub] [airflow] sarutak opened a new pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread GitBox
sarutak opened a new pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175 Emacs generates some types of backup files and yarn generates yarn.lock. They should be ignored by the

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574569284 > Have you tested it with GKE? Should we ensure integration with IAM? KubernetesPodOperator have support for IAM via

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574569602 @mik-laj can you review again? and share your thoughts This is an

[GitHub] [airflow] zhongjiajie commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
zhongjiajie commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574584283 Same Jira ticket https://issues.apache.org/jira/browse/AIRFLOW-4209, but my PR is close, maybe you should close your

[GitHub] [airflow] kaxil merged pull request #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
kaxil merged pull request #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader URL: https://github.com/apache/airflow/pull/7153#issuecomment-573743099 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7153?src=pr=h1) Report > :exclamation: No coverage

[GitHub] [airflow] codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader URL: https://github.com/apache/airflow/pull/7153#issuecomment-573743099 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7153?src=pr=h1) Report > :exclamation: No coverage

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366768981 ## File path: airflow/contrib/example_dags/example_spark_kubernetes_operator.py ## @@ -0,0

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366816324 ## File path: airflow/contrib/example_dags/example_spark_kubernetes_operator.py ## @@ -0,0

[jira] [Commented] (AIRFLOW-6568) Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015722#comment-17015722 ] ASF GitHub Bot commented on AIRFLOW-6568: - sarutak commented on pull request #7175:

[GitHub] [airflow] codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader URL: https://github.com/apache/airflow/pull/7153#issuecomment-573743099 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7153?src=pr=h1) Report > :exclamation: No coverage

[GitHub] [airflow] stale[bot] commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2020-01-15 Thread GitBox
stale[bot] commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-574578026 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no

[GitHub] [airflow] sarutak commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
sarutak commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574587809 @zhongjiajie Thanks for the information. I'll mark my JIRA ticket as duplicated and change the title of this PR.

[GitHub] [airflow] codecov-io commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
codecov-io commented on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574587251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7174?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574587251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7174?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil edited a comment on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
kaxil edited a comment on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574598968 臘‍♂ We have the wrong Jira id. It should have been https://issues.apache.org/jira/browse/AIRFLOW-4209

[GitHub] [airflow] kaxil commented on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
kaxil commented on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574598968 臘‍♂ We have the wrong Jira id. It should have been https://issues.apache.org/jira/browse/AIRFLOW-4209

[GitHub] [airflow] sarutak commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-15 Thread GitBox
sarutak commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-574602868 @potiuk All right. I'll do it. This is an

[GitHub] [airflow] codecov-io edited a comment on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters URL: https://github.com/apache/airflow/pull/7173#issuecomment-574544458 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7173?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters

2020-01-15 Thread GitBox
codecov-io commented on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters URL: https://github.com/apache/airflow/pull/7173#issuecomment-574544458 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7173?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4029) Loggin in to webserver through a dag page takes to the main UI dag view

2020-01-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015814#comment-17015814 ] ASF subversion and git services commented on AIRFLOW-4029: -- Commit

[jira] [Commented] (AIRFLOW-6566) Replace uses of imp still left with importlib.

2020-01-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015813#comment-17015813 ] ASF subversion and git services commented on AIRFLOW-6566: -- Commit

[jira] [Commented] (AIRFLOW-6566) Replace uses of imp still left with importlib.

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015811#comment-17015811 ] ASF GitHub Bot commented on AIRFLOW-6566: - kaxil commented on pull request #7174:

[jira] [Commented] (AIRFLOW-4375) Replace airflow.utils.file.TemporaryDirectory by native tempfile.TemporaryDirectory

2020-01-15 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015828#comment-17015828 ] zhongjiajie commented on AIRFLOW-4375: -- [~basph] [~kaxilnaik] This ticket is duplicates to 

[GitHub] [airflow] zhongjiajie commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-15 Thread GitBox
zhongjiajie commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#issuecomment-574548195 FYI, Travis-CI still sad, this time is timeout, may maybe you should test int you local breeze using `pytest -vs

[jira] [Created] (AIRFLOW-6567) Configuration broken when using proxy_fix

2020-01-15 Thread Tobias Edvardsson (Jira)
Tobias Edvardsson created AIRFLOW-6567: -- Summary: Configuration broken when using proxy_fix Key: AIRFLOW-6567 URL: https://issues.apache.org/jira/browse/AIRFLOW-6567 Project: Apache Airflow

[GitHub] [airflow] sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread GitBox
sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r366796894 ## File path: setup.cfg ## @@ -15,6 +15,9 @@ # specific

[GitHub] [airflow] sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread GitBox
sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r366800228 ## File path: .gitignore ## @@ -152,6 +157,7 @@ node_modules

[GitHub] [airflow] Bruschkov commented on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader

2020-01-15 Thread GitBox
Bruschkov commented on issue #7153: [AIRFLOW-5117] Fixed Timestamp bug in RefreshKubeConfigLoader URL: https://github.com/apache/airflow/pull/7153#issuecomment-574582795 @potiuk Everything solved and build passes now. Best regards

[GitHub] [airflow] kaxil commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r366795541 ## File path: .gitignore ## @@ -152,6 +157,7 @@ node_modules

[GitHub] [airflow] kaxil commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r366795644 ## File path: setup.cfg ## @@ -15,6 +15,9 @@ # specific

[GitHub] [airflow] sarutak commented on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib.

2020-01-15 Thread GitBox
sarutak commented on issue #7174: [AIRFLOW-6566][AIRFLOW-4029] Replace uses of imp still left with importlib. URL: https://github.com/apache/airflow/pull/7174#issuecomment-574602556 Oh, sorry about that... This is an

[jira] [Created] (AIRFLOW-6568) Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created AIRFLOW-6568: --- Summary: Add some more entries (Emacs related files and yarn.lock) to .gitignore Key: AIRFLOW-6568 URL: https://issues.apache.org/jira/browse/AIRFLOW-6568

[GitHub] [airflow] potiuk commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-15 Thread GitBox
potiuk commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r366792747 ## File path: .travis.yml ## @@ -87,6 +91,18 @@ jobs:

[GitHub] [airflow] potiuk commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-15 Thread GitBox
potiuk commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-574590856 BTW. It would be great if you rebase, to make sure that we only see changes from your change @sarutak

[jira] [Resolved] (AIRFLOW-4209) Replace imp by importlib

2020-01-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-4209. - Resolution: Fixed > Replace imp by importlib > > >

[jira] [Commented] (AIRFLOW-4209) Replace imp by importlib

2020-01-15 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015822#comment-17015822 ] zhongjiajie commented on AIRFLOW-4209: -- [~fokko] I could not close this ticket, it is duplicated

[GitHub] [airflow] RosterIn commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

2020-01-15 Thread GitBox
RosterIn commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-574649820 seems there is an issue @qlemaire22 `error: Incompatible default for argument

[jira] [Closed] (AIRFLOW-4375) Replace airflow.utils.file.TemporaryDirectory by native tempfile.TemporaryDirectory

2020-01-15 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak closed AIRFLOW-4375. -- Resolution: Duplicate > Replace airflow.utils.file.TemporaryDirectory by native >

[jira] [Commented] (AIRFLOW-6570) Add dag tag for all example dag

2020-01-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016059#comment-17016059 ] ASF subversion and git services commented on AIRFLOW-6570: -- Commit

[jira] [Commented] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters

2020-01-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016062#comment-17016062 ] ASF subversion and git services commented on AIRFLOW-6565: -- Commit

[jira] [Commented] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016060#comment-17016060 ] ASF GitHub Bot commented on AIRFLOW-6565: - mik-laj commented on pull request #7173:

[GitHub] [airflow] mik-laj merged pull request #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters

2020-01-15 Thread GitBox
mik-laj merged pull request #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters URL: https://github.com/apache/airflow/pull/7173 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-6570) Add dag tag for all example dag

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016058#comment-17016058 ] ASF GitHub Bot commented on AIRFLOW-6570: - potiuk commented on pull request #7176:

[GitHub] [airflow] mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574611262 @roitvt I am busy on the client's project, but I will try to come back this week.

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366816834 ## File path: airflow/contrib/sensors/spark_kubernetes_sensor.py ## @@ -0,0 +1,82 @@ +# -*-

[jira] [Created] (AIRFLOW-6571) Rewrite BigQueryExecuteQueryOperator to use python client

2020-01-15 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-6571: Summary: Rewrite BigQueryExecuteQueryOperator to use python client Key: AIRFLOW-6571 URL: https://issues.apache.org/jira/browse/AIRFLOW-6571 Project: Apache

[jira] [Resolved] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters

2020-01-15 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6565. Resolution: Fixed > BigQuery - replace deprecated connection parameters >

[GitHub] [airflow] zhongjiajie commented on issue #7176: [AIRFLOW-6570] Add dag tag for all example dag

2020-01-15 Thread GitBox
zhongjiajie commented on issue #7176: [AIRFLOW-6570] Add dag tag for all example dag URL: https://github.com/apache/airflow/pull/7176#issuecomment-574709581 Thanks Jarek. This is an automated message from the Apache Git

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366831219 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[GitHub] [airflow] aviemzur commented on issue #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2020-01-15 Thread GitBox
aviemzur commented on issue #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id URL: https://github.com/apache/airflow/pull/6655#issuecomment-574628821 @gorros Exponential back off was introduced to sensors in Airflow's master already.

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366820656 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[jira] [Created] (AIRFLOW-6569) Broken sentry integration

2020-01-15 Thread Robin Edwards (Jira)
Robin Edwards created AIRFLOW-6569: -- Summary: Broken sentry integration Key: AIRFLOW-6569 URL: https://issues.apache.org/jira/browse/AIRFLOW-6569 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-4375) Replace airflow.utils.file.TemporaryDirectory by native tempfile.TemporaryDirectory

2020-01-15 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016023#comment-17016023 ] Bas Harenslak commented on AIRFLOW-4375: [~zhongjiajie] thanks for the notice, closed >

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366922807 ## File path: docs/operators-and-hooks-ref.rst ## @@ -1049,8 +1049,11 @@ These integrations

[jira] [Commented] (AIRFLOW-6571) Rewrite BigQueryExecuteQueryOperator to use python client

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016069#comment-17016069 ] ASF GitHub Bot commented on AIRFLOW-6571: - nuclearpinguin commented on pull request #7177:

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366828700 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[jira] [Created] (AIRFLOW-6570) Add dag tag for all example dag

2020-01-15 Thread zhongjiajie (Jira)
zhongjiajie created AIRFLOW-6570: Summary: Add dag tag for all example dag Key: AIRFLOW-6570 URL: https://issues.apache.org/jira/browse/AIRFLOW-6570 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366816324 ## File path: airflow/contrib/example_dags/example_spark_kubernetes_operator.py ## @@ -0,0

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574622298 > @roitvt I am busy on the client's project, but I will try to come back this week. great thanks!!

[jira] [Commented] (AIRFLOW-6569) Broken sentry integration

2020-01-15 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015882#comment-17015882 ] Ash Berlin-Taylor commented on AIRFLOW-6569: See also

[GitHub] [airflow] TobKed commented on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters

2020-01-15 Thread GitBox
TobKed commented on issue #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters URL: https://github.com/apache/airflow/pull/7173#issuecomment-574628371 @kaxil I agree with you. Deprecated parameters can still be used, nothing is changed here. I've just replaced usage

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-15 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366918521 ## File path: airflow/contrib/sensors/spark_kubernetes_sensor.py ## @@ -0,0 +1,82 @@ +# -*-

[GitHub] [airflow] nuclearpinguin opened a new pull request #7177: [AIRFLOW-6571] Rewrite BigQueryExecuteQueryOperator to use python client

2020-01-15 Thread GitBox
nuclearpinguin opened a new pull request #7177: [AIRFLOW-6571] Rewrite BigQueryExecuteQueryOperator to use python client URL: https://github.com/apache/airflow/pull/7177 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366819968 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[GitHub] [airflow] gorros commented on issue #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id

2020-01-15 Thread GitBox
gorros commented on issue #6655: [AIRFLOW-6056] Allow EmrAddStepsOperator to accept job_flow_name as alternative to job_flow_id URL: https://github.com/apache/airflow/pull/6655#issuecomment-574622784 @aviemzur This is a great feature. Thanks for contribution. Currently I have couple of

[GitHub] [airflow] zhongjiajie opened a new pull request #7176: [AIRFLOW-6570] Add dag tag for all example dag

2020-01-15 Thread GitBox
zhongjiajie opened a new pull request #7176: [AIRFLOW-6570] Add dag tag for all example dag URL: https://github.com/apache/airflow/pull/7176 We miss add some dag tag in https://github.com/apache/airflow/pull/6489 This patch to add dag tag for all others --- Issue link: WILL

[jira] [Commented] (AIRFLOW-6570) Add dag tag for all example dag

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015942#comment-17015942 ] ASF GitHub Bot commented on AIRFLOW-6570: - zhongjiajie commented on pull request #7176:

[GitHub] [airflow] potiuk merged pull request #7176: [AIRFLOW-6570] Add dag tag for all example dag

2020-01-15 Thread GitBox
potiuk merged pull request #7176: [AIRFLOW-6570] Add dag tag for all example dag URL: https://github.com/apache/airflow/pull/7176 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] potiuk commented on issue #7176: [AIRFLOW-6570] Add dag tag for all example dag

2020-01-15 Thread GitBox
potiuk commented on issue #7176: [AIRFLOW-6570] Add dag tag for all example dag URL: https://github.com/apache/airflow/pull/7176#issuecomment-574699230 Nice! This is an automated message from the Apache Git Service. To

[jira] [Comment Edited] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-15 Thread Jacob Ward (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016155#comment-17016155 ] Jacob Ward edited comment on AIRFLOW-6556 at 1/15/20 5:09 PM: -- Here's a

[GitHub] [airflow] rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-15 Thread GitBox
rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r366998333 ## File path: airflow/sensors/external_task_sensor.py ## @@ -16,22 +16,71 @@ #

[GitHub] [airflow] codecov-io edited a comment on issue #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#issuecomment-561766454 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6660?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

2020-01-15 Thread GitBox
ashb commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r367041811 ## File path: airflow/cli/commands/dag_command.py ## @@ -208,8 +208,8 @@ def

[jira] [Commented] (AIRFLOW-6572) Move AWS classes to providers.amazon.aws package

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016105#comment-17016105 ] ASF GitHub Bot commented on AIRFLOW-6572: - mik-laj commented on pull request #7178:

[GitHub] [airflow] mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366967453 ## File path: UPDATING.md ## @@ -1336,6 +1328,20 @@ Installation and upgrading

[GitHub] [airflow] mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366970332 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars'

[jira] [Created] (AIRFLOW-6573) Bump `text-unidecode` version

2020-01-15 Thread Ray R (Jira)
Ray R created AIRFLOW-6573: -- Summary: Bump `text-unidecode` version Key: AIRFLOW-6573 URL: https://issues.apache.org/jira/browse/AIRFLOW-6573 Project: Apache Airflow Issue Type: Improvement

[GitHub] [airflow] rayrrr opened a new pull request #7179: [AIRFLOW-6573] bump `text-unidecode` version for Python 3.7

2020-01-15 Thread GitBox
rayrrr opened a new pull request #7179: [AIRFLOW-6573] bump `text-unidecode` version for Python 3.7 URL: https://github.com/apache/airflow/pull/7179 `text-unidecode` version 1.3 was recently released and it includes explicit support for Python 3.7. This should be the dependency since we

[GitHub] [airflow] codecov-io edited a comment on issue #6660: [AIRFLOW-6065] Add Stackdriver Task Handler

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #6660: [AIRFLOW-6065] Add Stackdriver Task Handler URL: https://github.com/apache/airflow/pull/6660#issuecomment-561766454 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6660?src=pr=h1) Report > Merging

[GitHub] [airflow] rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-15 Thread GitBox
rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r367030797 ## File path: airflow/sensors/external_task_sensor.py ## @@ -16,22 +16,71 @@ #

[jira] [Created] (AIRFLOW-6572) [AIRFLOW-6552] Move AWS classes to providers.amazon.aws package

2020-01-15 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6572: -- Summary: [AIRFLOW-6552] Move AWS classes to providers.amazon.aws package Key: AIRFLOW-6572 URL: https://issues.apache.org/jira/browse/AIRFLOW-6572 Project:

[jira] [Updated] (AIRFLOW-6572) [AIRFLOW-6552] Move AWS classes to providers.amazon.aws package

2020-01-15 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6572: --- Description: More information: 

[jira] [Updated] (AIRFLOW-6572) Move AWS classes to providers.amazon.aws package

2020-01-15 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6572: --- Summary: Move AWS classes to providers.amazon.aws package (was: [AIRFLOW-6552] Move AWS

[GitHub] [airflow] ashb commented on issue #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter

2020-01-15 Thread GitBox
ashb commented on issue #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter URL: https://github.com/apache/airflow/pull/7159#issuecomment-574743346 When making UI changes like this it's helpful to include a before-and-after. Could you please? It's probably fine,

[jira] [Commented] (AIRFLOW-6573) Bump `text-unidecode` version

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016154#comment-17016154 ] ASF GitHub Bot commented on AIRFLOW-6573: - rayrrr commented on pull request #7179:

[GitHub] [airflow] mik-laj opened a new pull request #7178: [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package

2020-01-15 Thread GitBox
mik-laj opened a new pull request #7178: [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package URL: https://github.com/apache/airflow/pull/7178 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below

[GitHub] [airflow] potiuk commented on issue #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure

2020-01-15 Thread GitBox
potiuk commented on issue #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure URL: https://github.com/apache/airflow/pull/7172#issuecomment-574729925 For now I have not yet tried to improve entropy retrieval from Docker (I will see if that can be achieved easily)

[GitHub] [airflow] mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-15 Thread GitBox
mattbowden-ookla commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366968756 ## File path: UPDATING.md ## @@ -1043,6 +1019,12 @@

[GitHub] [airflow] benjamingrenier commented on issue #5676: [AIRFLOW-5062] Add support for getting/setting ACL in S3Hook

2020-01-15 Thread GitBox
benjamingrenier commented on issue #5676: [AIRFLOW-5062] Add support for getting/setting ACL in S3Hook URL: https://github.com/apache/airflow/pull/5676#issuecomment-574737827 Any update on this PR ? This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure

2020-01-15 Thread GitBox
mik-laj commented on a change in pull request #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure URL: https://github.com/apache/airflow/pull/7172#discussion_r366997311 ## File path: airflow/utils/db.py ## @@ -501,3 +501,13 @@ def resetdb():

[jira] [Assigned] (AIRFLOW-6094) Mysql script for 1.8 to 1.10 airflow db upgrade

2020-01-15 Thread Ananth Packkildurai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ananth Packkildurai reassigned AIRFLOW-6094: Assignee: Ananth Packkildurai (was: Ananth PackkilDurai) > Mysql

[GitHub] [airflow] codecov-io commented on issue #7179: [AIRFLOW-6573] bump `text-unidecode` version for Python 3.7

2020-01-15 Thread GitBox
codecov-io commented on issue #7179: [AIRFLOW-6573] bump `text-unidecode` version for Python 3.7 URL: https://github.com/apache/airflow/pull/7179#issuecomment-574803822 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7179?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-15 Thread GitBox
ashb commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367051937 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,66 @@ def

[GitHub] [airflow] codecov-io edited a comment on issue #7158: [AIRFLOW-6552] Move Azure classes to providers.microsoft package

2020-01-15 Thread GitBox
codecov-io edited a comment on issue #7158: [AIRFLOW-6552] Move Azure classes to providers.microsoft package URL: https://github.com/apache/airflow/pull/7158#issuecomment-573956076 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7158?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6560) db password leaks to logs

2020-01-15 Thread Robert Conroy (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016221#comment-17016221 ] Robert Conroy commented on AIRFLOW-6560: [~mkjasinski] I see a similar message on my setup when

[GitHub] [airflow] ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

2020-01-15 Thread GitBox
ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#issuecomment-574766407 Tests should be passing now, and we've been running a back-ported version of this for a few weeks and it makes a

[GitHub] [airflow] codecov-io commented on issue #7178: [AIRFLOW-6572][depends on AIRFLOW-6552] Move AWS classes to providers.amazon.aws package

2020-01-15 Thread GitBox
codecov-io commented on issue #7178: [AIRFLOW-6572][depends on AIRFLOW-6552] Move AWS classes to providers.amazon.aws package URL: https://github.com/apache/airflow/pull/7178#issuecomment-574766638 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7178?src=pr=h1) Report > Merging

[GitHub] [airflow] rayrrr opened a new pull request #7180: --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg)

2020-01-15 Thread GitBox
rayrrr opened a new pull request #7180: --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) URL: https://github.com/apache/airflow/pull/7180 Make sure to mark the boxes below before creating PR: [x] - [ ] Description above provides context of

  1   2   3   >