[GitHub] [airflow] potiuk commented on issue #5609: [AIRFLOW-4994] Bare version of integration test environment

2019-07-23 Thread GitBox
potiuk commented on issue #5609: [AIRFLOW-4994] Bare version of integration test environment URL: https://github.com/apache/airflow/pull/5609#issuecomment-514502770 Closing. It's been already merged together with #5625 This

[GitHub] [airflow] potiuk closed pull request #5609: [AIRFLOW-4994] Bare version of integration test environment

2019-07-23 Thread GitBox
potiuk closed pull request #5609: [AIRFLOW-4994] Bare version of integration test environment URL: https://github.com/apache/airflow/pull/5609 This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Commented] (AIRFLOW-4994) Bare version of integration test environment

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891633#comment-16891633 ] ASF GitHub Bot commented on AIRFLOW-4994: - potiuk commented on pull request #56

[jira] [Resolved] (AIRFLOW-4994) Bare version of integration test environment

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-4994. --- Resolution: Fixed Fix Version/s: 1.10.4 > Bare version of integration test environme

[jira] [Updated] (AIRFLOW-4994) Bare version of integration test environment

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-4994: -- Summary: Bare version of integration test environment (was: Slim version of integration test

[jira] [Resolved] (AIRFLOW-5002) CI local environment does not suggest getopt installation properly when you use zsh on Mac

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5002. --- Resolution: Fixed Fix Version/s: 1.10.4 > CI local environment does not suggest geto

[jira] [Commented] (AIRFLOW-5005) Kubernetes tests should be split to separate jobs

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891627#comment-16891627 ] ASF GitHub Bot commented on AIRFLOW-5005: - potiuk commented on pull request #56

[jira] [Resolved] (AIRFLOW-5005) Kubernetes tests should be split to separate jobs

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5005. --- Resolution: Fixed Fix Version/s: 1.10.4 > Kubernetes tests should be split to separa

[GitHub] [airflow] Fokko commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-07-23 Thread GitBox
Fokko commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-514501057 @milton0825 Can you do a rebase onto latest master? Thi

[jira] [Commented] (AIRFLOW-5005) Kubernetes tests should be split to separate jobs

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891628#comment-16891628 ] ASF subversion and git services commented on AIRFLOW-5005: -- Co

[GitHub] [airflow] potiuk merged pull request #5625: [AIRFLOW-5005] Split kubernetes tests

2019-07-23 Thread GitBox
potiuk merged pull request #5625: [AIRFLOW-5005] Split kubernetes tests URL: https://github.com/apache/airflow/pull/5625 This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [airflow] mik-laj edited a comment on issue #5627: [AIRFLOW-5003] Making AWS Hooks pylint compatible

2019-07-23 Thread GitBox
mik-laj edited a comment on issue #5627: [AIRFLOW-5003] Making AWS Hooks pylint compatible URL: https://github.com/apache/airflow/pull/5627#issuecomment-514495768 I deleted unrelated changes from this PR. ``` CONTRIBUTING.md | 1 - tests/contr

[GitHub] [airflow] mik-laj commented on issue #5627: [AIRFLOW-5003] Making AWS Hooks pylint compatible

2019-07-23 Thread GitBox
mik-laj commented on issue #5627: [AIRFLOW-5003] Making AWS Hooks pylint compatible URL: https://github.com/apache/airflow/pull/5627#issuecomment-514495768 I deleted a unrelated changes from this PR. ``` CONTRIBUTING.md | 1 - tests/contrib/op

[GitHub] [airflow] mik-laj commented on issue #5648: [AIRFLOW-5001] Moving building image to before_install phase

2019-07-23 Thread GitBox
mik-laj commented on issue #5648: [AIRFLOW-5001] Moving building image to before_install phase URL: https://github.com/apache/airflow/pull/5648#issuecomment-514481258 I restarted kube job. This is an automated message from th

[GitHub] [airflow] mik-laj commented on issue #5652: [AIRFLOW-5034] Raise exceptions for errors in cli.

2019-07-23 Thread GitBox
mik-laj commented on issue #5652: [AIRFLOW-5034] Raise exceptions for errors in cli. URL: https://github.com/apache/airflow/pull/5652#issuecomment-514480059 I think that it is worth creating separate correct exceptions and throwing them. The new exception should be handled by the CLI and s

[GitHub] [airflow] potiuk commented on issue #5648: [AIRFLOW-5001] Moving building image to before_install phase

2019-07-23 Thread GitBox
potiuk commented on issue #5648: [AIRFLOW-5001] Moving building image to before_install phase URL: https://github.com/apache/airflow/pull/5648#issuecomment-514476201 @ashb @mik-laj - this nice change hides the image building phase as it moves to "before_install". It makes the logs for stat

[GitHub] [airflow] potiuk commented on issue #5642: [AIRFLOW-XXX] Better troubleshooting docs in CONTRIBUTING.md

2019-07-23 Thread GitBox
potiuk commented on issue #5642: [AIRFLOW-XXX] Better troubleshooting docs in CONTRIBUTING.md URL: https://github.com/apache/airflow/pull/5642#issuecomment-514475780 @dimberman - Your grammar changes. Please take a look :).

[GitHub] [airflow] potiuk commented on issue #5609: [AIRFLOW-4994] Bare version of integration test environment

2019-07-23 Thread GitBox
potiuk commented on issue #5609: [AIRFLOW-4994] Bare version of integration test environment URL: https://github.com/apache/airflow/pull/5609#issuecomment-514475707 @mik-laj -> bare environment for you to approve. This is an

[GitHub] [airflow] potiuk commented on issue #5625: [AIRFLOW-5005] Split kubernetes tests

2019-07-23 Thread GitBox
potiuk commented on issue #5625: [AIRFLOW-5005] Split kubernetes tests URL: https://github.com/apache/airflow/pull/5625#issuecomment-514475602 @ashb @dimberman @mik-laj -> small improvement in a way we run tests in CI, curently often the kubernetes tests fail because we are re-deploying and

[jira] [Commented] (AIRFLOW-5034) CLI errors should exit with non-zero codes

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891582#comment-16891582 ] ASF GitHub Bot commented on AIRFLOW-5034: - jmcarp commented on pull request #56

[GitHub] [airflow] jmcarp commented on issue #5652: [AIRFLOW-5034] Raise exceptions for errors in cli.

2019-07-23 Thread GitBox
jmcarp commented on issue #5652: [AIRFLOW-5034] Raise exceptions for errors in cli. URL: https://github.com/apache/airflow/pull/5652#issuecomment-514469342 cc @ashb @mik-laj This is an automated message from the Apache Git Se

[GitHub] [airflow] jmcarp opened a new pull request #5652: [AIRFLOW-5034] Raise exceptions for errors in cli.

2019-07-23 Thread GitBox
jmcarp opened a new pull request #5652: [AIRFLOW-5034] Raise exceptions for errors in cli. URL: https://github.com/apache/airflow/pull/5652 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira

[jira] [Created] (AIRFLOW-5034) CLI errors should exit with non-zero codes

2019-07-23 Thread Josh Carp (JIRA)
Josh Carp created AIRFLOW-5034: -- Summary: CLI errors should exit with non-zero codes Key: AIRFLOW-5034 URL: https://issues.apache.org/jira/browse/AIRFLOW-5034 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-5025) DataflowPythonOperator uses Python2

2019-07-23 Thread Shuhei Fujiwara (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891578#comment-16891578 ] Shuhei Fujiwara commented on AIRFLOW-5025: -- Sorry, I overlooked the issue:  ht

[GitHub] [airflow] yuqian90 commented on issue #5616: [AIRFLOW-4013] Fix Mark Success/Failed picking all execution_date bug

2019-07-23 Thread GitBox
yuqian90 commented on issue #5616: [AIRFLOW-4013] Fix Mark Success/Failed picking all execution_date bug URL: https://github.com/apache/airflow/pull/5616#issuecomment-514461428 Tagging some authors who worked on those code previously: @potiuk @bolkedebruin would you be interested in rev

[jira] [Commented] (AIRFLOW-5025) DataflowPythonOperator uses Python2

2019-07-23 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891469#comment-16891469 ] Ryan Yuan commented on AIRFLOW-5025: Duplicated. [https://issues.apache.org/jira/b

[GitHub] [airflow] LamaAni closed pull request #5646: Merge changes from apache airflow master with tags.

2019-07-23 Thread GitBox
LamaAni closed pull request #5646: Merge changes from apache airflow master with tags. URL: https://github.com/apache/airflow/pull/5646 This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [airflow] LamaAni commented on issue #5646: Merge changes from apache airflow master with tags.

2019-07-23 Thread GitBox
LamaAni commented on issue #5646: Merge changes from apache airflow master with tags. URL: https://github.com/apache/airflow/pull/5646#issuecomment-514419944 > @LamaAni -> isn't it already in master? Why do you want to merge it? Hi Sincere apologies, We have a fork and I comm

[GitHub] [airflow] LamaAni edited a comment on issue #5646: Merge changes from apache airflow master with tags.

2019-07-23 Thread GitBox
LamaAni edited a comment on issue #5646: Merge changes from apache airflow master with tags. URL: https://github.com/apache/airflow/pull/5646#issuecomment-514419944 > @LamaAni -> isn't it already in master? Why do you want to merge it? @potiuk Hi Sincere apologies, We

[jira] [Resolved] (AIRFLOW-5011) Add typehints for GCP Vision operators

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5011. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add typehints for GCP Vision operators > --

[jira] [Commented] (AIRFLOW-5011) Add typehints for GCP Vision operators

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891461#comment-16891461 ] ASF subversion and git services commented on AIRFLOW-5011: -- Co

[jira] [Commented] (AIRFLOW-5011) Add typehints for GCP Vision operators

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891460#comment-16891460 ] ASF GitHub Bot commented on AIRFLOW-5011: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk merged pull request #5632: [AIRFLOW-5011] Add typehints for GCP Vision operators

2019-07-23 Thread GitBox
potiuk merged pull request #5632: [AIRFLOW-5011] Add typehints for GCP Vision operators URL: https://github.com/apache/airflow/pull/5632 This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [airflow] potiuk commented on issue #5631: [AIRFLOW-5010] Add typehints for core operators

2019-07-23 Thread GitBox
potiuk commented on issue #5631: [AIRFLOW-5010] Add typehints for core operators URL: https://github.com/apache/airflow/pull/5631#issuecomment-514418964 @mik-laj please rebase and push so that Travis can build it. Travis had a problem whole day yesterday. --

[GitHub] [airflow] potiuk commented on issue #5647: [AIRFLOW-3628] Add smtp_mime_from

2019-07-23 Thread GitBox
potiuk commented on issue #5647: [AIRFLOW-3628] Add smtp_mime_from URL: https://github.com/apache/airflow/pull/5647#issuecomment-514418663 @OmerJog please rebase and push so that Travis can build it. Travis had a problem whole day yesterday.

[GitHub] [airflow] potiuk commented on issue #5646: Merge changes from apache airflow master with tags.

2019-07-23 Thread GitBox
potiuk commented on issue #5646: Merge changes from apache airflow master with tags. URL: https://github.com/apache/airflow/pull/5646#issuecomment-514418559 @LamaAni -> isn't it already in master? Why do you want to merge it?

[GitHub] [airflow] potiuk commented on issue #5645: [AIRFLOW-5027] Generalized CloudWatch log grabbing for ECS and SageMaker operators

2019-07-23 Thread GitBox
potiuk commented on issue #5645: [AIRFLOW-5027] Generalized CloudWatch log grabbing for ECS and SageMaker operators URL: https://github.com/apache/airflow/pull/5645#issuecomment-514418381 @StevenReitsma please rebase and push so that Travis can build it. Travis had a problem whole day yest

[GitHub] [airflow] potiuk commented on issue #5644: [AIRFLOW-5022] Fixes DockerHook for registries with port numbers

2019-07-23 Thread GitBox
potiuk commented on issue #5644: [AIRFLOW-5022] Fixes DockerHook for registries with port numbers URL: https://github.com/apache/airflow/pull/5644#issuecomment-514418320 @iantruslove please rebase and push so that Travis can build it. Travis had a problem whole day yesterday. ---

[GitHub] [airflow] potiuk commented on issue #5639: [AIRFLOW-4883] Add missing code lost during rebase of original commit

2019-07-23 Thread GitBox
potiuk commented on issue #5639: [AIRFLOW-4883] Add missing code lost during rebase of original commit URL: https://github.com/apache/airflow/pull/5639#issuecomment-514418202 @aoen please rebase and push so that Travis can build it. Travis had a problem whole day yesterday. --

[GitHub] [airflow] potiuk edited a comment on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-07-23 Thread GitBox
potiuk edited a comment on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-514417975 @CatarinaSilva -> please rebase and push so that Travis can build it. Travis had a problem whole day yesterday.

[GitHub] [airflow] potiuk commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-07-23 Thread GitBox
potiuk commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-514417975 @CatarinaSilva -> please rebase and push so that Travis can build it. This is an au

[jira] [Commented] (AIRFLOW-5002) CI local environment does not suggest getopt installation properly when you use zsh on Mac

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891453#comment-16891453 ] ASF subversion and git services commented on AIRFLOW-5002: -- Co

[jira] [Commented] (AIRFLOW-5002) CI local environment does not suggest getopt installation properly when you use zsh on Mac

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891452#comment-16891452 ] ASF GitHub Bot commented on AIRFLOW-5002: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk merged pull request #5623: [AIRFLOW-5002] Diagnostics of getopt fixed for zsh on MacOS

2019-07-23 Thread GitBox
potiuk merged pull request #5623: [AIRFLOW-5002] Diagnostics of getopt fixed for zsh on MacOS URL: https://github.com/apache/airflow/pull/5623 This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Created] (AIRFLOW-5033) Cannot install apache-airflow[kerberos] on Python 3

2019-07-23 Thread Mathew Wicks (JIRA)
Mathew Wicks created AIRFLOW-5033: - Summary: Cannot install apache-airflow[kerberos] on Python 3 Key: AIRFLOW-5033 URL: https://issues.apache.org/jira/browse/AIRFLOW-5033 Project: Apache Airflow

[GitHub] [airflow] jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306556878 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -381,17 +392,24 @@ def start_python_da

[jira] [Closed] (AIRFLOW-5032) build is broken due to version conflict between tzlocal and pendulum

2019-07-23 Thread QP Hou (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou closed AIRFLOW-5032. --- Resolution: Duplicate > build is broken due to version conflict between tzlocal and pendulum >

[jira] [Commented] (AIRFLOW-5032) build is broken due to version conflict between tzlocal and pendulum

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891406#comment-16891406 ] ASF GitHub Bot commented on AIRFLOW-5032: - houqp commented on pull request #565

[GitHub] [airflow] houqp closed pull request #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum

2019-07-23 Thread GitBox
houqp closed pull request #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum URL: https://github.com/apache/airflow/pull/5651 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [airflow] houqp commented on issue #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum

2019-07-23 Thread GitBox
houqp commented on issue #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum URL: https://github.com/apache/airflow/pull/5651#issuecomment-514396842 never mind, @potiuk beat me to it :) This is an automate

[jira] [Commented] (AIRFLOW-5032) build is broken due to version conflict between tzlocal and pendulum

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891405#comment-16891405 ] ASF GitHub Bot commented on AIRFLOW-5032: - houqp commented on pull request #565

[GitHub] [airflow] houqp opened a new pull request #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum

2019-07-23 Thread GitBox
houqp opened a new pull request #5651: [AIRFLOW-5032] fix version conflict between tzlocal and pendulum URL: https://github.com/apache/airflow/pull/5651 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.ap

[jira] [Created] (AIRFLOW-5032) build is broken due to version conflict between tzlocal and pendulum

2019-07-23 Thread QP Hou (JIRA)
QP Hou created AIRFLOW-5032: --- Summary: build is broken due to version conflict between tzlocal and pendulum Key: AIRFLOW-5032 URL: https://issues.apache.org/jira/browse/AIRFLOW-5032 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-4999) The ci_local_build and ci_local_pull_and_build pull only test image

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-4999. --- Resolution: Fixed Fix Version/s: 1.10.4 > The ci_local_build and ci_local_pull_and_

[jira] [Commented] (AIRFLOW-4999) The ci_local_build and ci_local_pull_and_build pull only test image

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891387#comment-16891387 ] ASF GitHub Bot commented on AIRFLOW-4999: - potiuk commented on pull request #56

[jira] [Commented] (AIRFLOW-4999) The ci_local_build and ci_local_pull_and_build pull only test image

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891388#comment-16891388 ] ASF subversion and git services commented on AIRFLOW-4999: -- Co

[GitHub] [airflow] potiuk merged pull request #5621: [AIRFLOW-4999] Pull and build local work on both images

2019-07-23 Thread GitBox
potiuk merged pull request #5621: [AIRFLOW-4999] Pull and build local work on both images URL: https://github.com/apache/airflow/pull/5621 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5030) config key name with __ in it is getting skipped in AirflowConfigParser.as_dict method

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891385#comment-16891385 ] ASF GitHub Bot commented on AIRFLOW-5030: - houqp commented on pull request #565

[GitHub] [airflow] houqp opened a new pull request #5650: [AIRFLOW-5030] fix env var expansion for config key contains __

2019-07-23 Thread GitBox
houqp opened a new pull request #5650: [AIRFLOW-5030] fix env var expansion for config key contains __ URL: https://github.com/apache/airflow/pull/5650 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apa

[jira] [Commented] (AIRFLOW-5031) Tzlocal 2.0.0 has been released today and it breaks the build

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891382#comment-16891382 ] ASF subversion and git services commented on AIRFLOW-5031: -- Co

[jira] [Commented] (AIRFLOW-5031) Tzlocal 2.0.0 has been released today and it breaks the build

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891381#comment-16891381 ] ASF GitHub Bot commented on AIRFLOW-5031: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk merged pull request #5649: [AIRFLOW-5031] Added limit on tzlocal release

2019-07-23 Thread GitBox
potiuk merged pull request #5649: [AIRFLOW-5031] Added limit on tzlocal release URL: https://github.com/apache/airflow/pull/5649 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306529184 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -381,17 +392,24 @@ def start_python_da

[GitHub] [airflow] fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306527023 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -381,17 +392,24 @@ def start_python_

[GitHub] [airflow] fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306527244 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -381,17 +392,24 @@ def start_python_

[GitHub] [airflow] fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
fenglu-g commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306527445 ## File path: airflow/contrib/operators/dataflow_operator.py ## @@ -351,6 +352,9 @@ class DataFlowP

[GitHub] [airflow] ashb commented on issue #5649: [AIRFLOW-5031] Added limit on tzlocal release

2019-07-23 Thread GitBox
ashb commented on issue #5649: [AIRFLOW-5031] Added limit on tzlocal release URL: https://github.com/apache/airflow/pull/5649#issuecomment-514376100 I remain continually amazed at how bad pip's version constraint solver is. Like this one shouldn't even be an issue as we did have an incompat

[jira] [Commented] (AIRFLOW-5031) Tzlocal 2.0.0 has been released today and it breaks the build

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891363#comment-16891363 ] ASF GitHub Bot commented on AIRFLOW-5031: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk opened a new pull request #5649: [AIRFLOW-5031] Added limit on tzlocal release

2019-07-23 Thread GitBox
potiuk opened a new pull request #5649: [AIRFLOW-5031] Added limit on tzlocal release URL: https://github.com/apache/airflow/pull/5649 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/brow

[jira] [Created] (AIRFLOW-5031) Tzlocal 2.0.0 has been released today and it breaks the build

2019-07-23 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5031: - Summary: Tzlocal 2.0.0 has been released today and it breaks the build Key: AIRFLOW-5031 URL: https://issues.apache.org/jira/browse/AIRFLOW-5031 Project: Apache Air

[jira] [Created] (AIRFLOW-5030) config key name with __ in it is getting skipped in AirflowConfigParser.as_dict method

2019-07-23 Thread QP Hou (JIRA)
QP Hou created AIRFLOW-5030: --- Summary: config key name with __ in it is getting skipped in AirflowConfigParser.as_dict method Key: AIRFLOW-5030 URL: https://issues.apache.org/jira/browse/AIRFLOW-5030 Projec

[jira] [Commented] (AIRFLOW-5001) The CI build logs in travis contain image building log in main script

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891339#comment-16891339 ] ASF GitHub Bot commented on AIRFLOW-5001: - potiuk commented on pull request #56

[jira] [Updated] (AIRFLOW-4939) Ability to specify default retries for all tasks

2019-07-23 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4939: --- Fix Version/s: 2.0.0 > Ability to specify default retries for all tasks > -

[GitHub] [airflow] potiuk opened a new pull request #5648: [AIRFLOW-5001] Moving building image to before_install phase

2019-07-23 Thread GitBox
potiuk opened a new pull request #5648: [AIRFLOW-5001] Moving building image to before_install phase URL: https://github.com/apache/airflow/pull/5648 (cherry picked from commit 15d78b723db3bf05f845025fcceafe3170563063) Make sure you have checked _all_ steps below. ### Jira

[jira] [Commented] (AIRFLOW-5001) The CI build logs in travis contain image building log in main script

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891324#comment-16891324 ] ASF GitHub Bot commented on AIRFLOW-5001: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk closed pull request #5622: [AIRFLOW-5001] Move building images to before install

2019-07-23 Thread GitBox
potiuk closed pull request #5622: [AIRFLOW-5001] Move building images to before install URL: https://github.com/apache/airflow/pull/5622 This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

2019-07-23 Thread Felipe Rodrigues (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891323#comment-16891323 ] Felipe Rodrigues commented on AIRFLOW-2902: --- [~jackjack10] Interesting approa

[jira] [Resolved] (AIRFLOW-5008) The libmysqlclient-dev disappeared from Oracle's ubuntu repos

2019-07-23 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5008. --- Resolution: Fixed Fix Version/s: 1.10.4 > The libmysqlclient-dev disappeared from Or

[jira] [Commented] (AIRFLOW-5008) The libmysqlclient-dev disappeared from Oracle's ubuntu repos

2019-07-23 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891321#comment-16891321 ] ASF subversion and git services commented on AIRFLOW-5008: -- Co

[jira] [Commented] (AIRFLOW-5008) The libmysqlclient-dev disappeared from Oracle's ubuntu repos

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891320#comment-16891320 ] ASF GitHub Bot commented on AIRFLOW-5008: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk merged pull request #5629: [AIRFLOW-5008] Fixed missing libmysql-client-dev in Oracle repos

2019-07-23 Thread GitBox
potiuk merged pull request #5629: [AIRFLOW-5008] Fixed missing libmysql-client-dev in Oracle repos URL: https://github.com/apache/airflow/pull/5629 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-3628) set MIME from in alert email

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891319#comment-16891319 ] ASF GitHub Bot commented on AIRFLOW-3628: - OmerJog commented on pull request #5

[GitHub] [airflow] OmerJog opened a new pull request #5647: [AIRFLOW-3628] Add smtp_mime_from

2019-07-23 Thread GitBox
OmerJog opened a new pull request #5647: [AIRFLOW-3628] Add smtp_mime_from URL: https://github.com/apache/airflow/pull/5647 https://issues.apache.org/jira/browse/AIRFLOW-3628 PR again the stale https://github.com/apache/airflow/pull/4435 Description In airflow alert email, the v

[GitHub] [airflow] LamaAni opened a new pull request #5646: Apache master

2019-07-23 Thread GitBox
LamaAni opened a new pull request #5646: Apache master URL: https://github.com/apache/airflow/pull/5646 Automatic pull/pr from apache master failed due to conflict. Fixed. Missing tags from apache master for 1.10.3 added.

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

2019-07-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891301#comment-16891301 ] jack commented on AIRFLOW-2902: --- [~fbidu] By direct I meant Mongo to Google Storage and t

[GitHub] [airflow] milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-07-23 Thread GitBox
milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-514335580 It passed on my personal travis: https://travis-ci.org/milton0825/airflow/builds/562446362 ---

[GitHub] [airflow] jaketf commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
jaketf commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#issuecomment-514331227 Why has the travis CI check disappeared? This is an automated message f

[GitHub] [airflow] jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306468685 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -369,7 +379,7 @@ def start_template_da

[GitHub] [airflow] pgagnon commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-07-23 Thread GitBox
pgagnon commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-514315710 @dimberman This is an automated message from the Apache Git Service. To respond t

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

2019-07-23 Thread Felipe Rodrigues (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891241#comment-16891241 ] Felipe Rodrigues commented on AIRFLOW-2902: --- [~jackjack10] by direct you mean

[GitHub] [airflow] OmerJog commented on a change in pull request #4341: [AIRFLOW-3537] Add task_definition as templated parameter in AWS ECS Operator

2019-07-23 Thread GitBox
OmerJog commented on a change in pull request #4341: [AIRFLOW-3537] Add task_definition as templated parameter in AWS ECS Operator URL: https://github.com/apache/airflow/pull/4341#discussion_r306426651 ## File path: tests/contrib/operators/test_ecs_operator.py ## @@ -95,7

[jira] [Commented] (AIRFLOW-5025) DataflowPythonOperator uses Python2

2019-07-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891150#comment-16891150 ] jack commented on AIRFLOW-5025: --- [~higrys] What do you think? > DataflowPythonOperator u

[jira] [Commented] (AIRFLOW-4939) Ability to specify default retries for all tasks

2019-07-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891130#comment-16891130 ] jack commented on AIRFLOW-4939: --- [~ash] Probably needs to set to which fix version it's g

[GitHub] [airflow] jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-07-23 Thread GitBox
jaketf commented on a change in pull request #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#discussion_r306365774 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -369,7 +379,7 @@ def start_template_da

[jira] [Commented] (AIRFLOW-5027) Generalized CloudWatch log grabbing for ECS and SageMaker operators

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891086#comment-16891086 ] ASF GitHub Bot commented on AIRFLOW-5027: - StevenReitsma commented on pull requ

[GitHub] [airflow] StevenReitsma opened a new pull request #5645: [AIRFLOW-5027] Generalized CloudWatch log grabbing for ECS and SageMaker operators

2019-07-23 Thread GitBox
StevenReitsma opened a new pull request #5645: [AIRFLOW-5027] Generalized CloudWatch log grabbing for ECS and SageMaker operators URL: https://github.com/apache/airflow/pull/5645 My first Airflow PR so I hope I adhered to all the contribution guidelines. All comments welcome. ---

[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

2019-07-23 Thread David Lum (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891073#comment-16891073 ] David Lum commented on AIRFLOW-4515: Just to point out that your example actually s

[jira] [Created] (AIRFLOW-5029) Migrate out of Travis CI

2019-07-23 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5029: - Summary: Migrate out of Travis CI Key: AIRFLOW-5029 URL: https://issues.apache.org/jira/browse/AIRFLOW-5029 Project: Apache Airflow Issue Type: Improvement

[jira] [Commented] (AIRFLOW-5022) DockerHook ignores connection port

2019-07-23 Thread Ian Truslove (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891040#comment-16891040 ] Ian Truslove commented on AIRFLOW-5022: --- https://github.com/apache/airflow/pull/5

[jira] [Commented] (AIRFLOW-5022) DockerHook ignores connection port

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891039#comment-16891039 ] ASF GitHub Bot commented on AIRFLOW-5022: - iantruslove commented on pull reques

  1   2   >