[GitHub] [airflow] dstandish commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
dstandish commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#issuecomment-531580727 @mik-laj thank you -- did not realize there was this doc. I have updated.

[GitHub] [airflow] potiuk merged pull request #6049: [AIRFLOW-XXX] Add prerequisite tasks for all GCP operators guide

2019-09-15 Thread GitBox
potiuk merged pull request #6049: [AIRFLOW-XXX] Add prerequisite tasks for all GCP operators guide URL: https://github.com/apache/airflow/pull/6049 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324480637 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[jira] [Assigned] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread Adan Christian Rosales Ornelas (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adan Christian Rosales Ornelas reassigned AIRFLOW-5495: --- Assignee: Adan Christian Rosales Ornelas > Remove

[GitHub] [airflow] mik-laj commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105#discussion_r324480808 ## File path: airflow/gcp/operators/dataproc.py ## @@ -407,7 +407,7 @@ def

[jira] [Resolved] (AIRFLOW-5427) Add system tests for Dataflow

2019-09-15 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5427. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add system tests for Dataflow >

[jira] [Commented] (AIRFLOW-5427) Add system tests for Dataflow

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930031#comment-16930031 ] ASF subversion and git services commented on AIRFLOW-5427: -- Commit

[GitHub] [airflow] potiuk merged pull request #6035: [AIRFLOW-5427][depends on AIRFLOW-5428/AIRFLOW-5453] Add system tests for Dataflow integration

2019-09-15 Thread GitBox
potiuk merged pull request #6035: [AIRFLOW-5427][depends on AIRFLOW-5428/AIRFLOW-5453] Add system tests for Dataflow integration URL: https://github.com/apache/airflow/pull/6035 This is an automated message from the Apache

[jira] [Resolved] (AIRFLOW-5428) Dataflow with one job is not done correctly

2019-09-15 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5428. --- Fix Version/s: 2.0.0 Resolution: Fixed > Dataflow with one job is not done

[jira] [Commented] (AIRFLOW-5428) Dataflow with one job is not done correctly

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930027#comment-16930027 ] ASF GitHub Bot commented on AIRFLOW-5428: - potiuk commented on pull request #6036:

[jira] [Commented] (AIRFLOW-5428) Dataflow with one job is not done correctly

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930028#comment-16930028 ] ASF subversion and git services commented on AIRFLOW-5428: -- Commit

[jira] [Commented] (AIRFLOW-5427) Add system tests for Dataflow

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930029#comment-16930029 ] ASF GitHub Bot commented on AIRFLOW-5427: - potiuk commented on pull request #6035:

[jira] [Commented] (AIRFLOW-5453) Improve reading inputs from Dataflow console

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930030#comment-16930030 ] ASF subversion and git services commented on AIRFLOW-5453: -- Commit

[GitHub] [airflow] mik-laj commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#discussion_r324480874 ## File path: docs/howto/connection/ssh.rst ## @@ -62,8 +63,14 @@ Extra (optional)

[GitHub] [airflow] potiuk opened a new pull request #6115: [AIRFLOW-5150] Implement POC for GitLab + Kubernetes tests

2019-09-15 Thread GitBox
potiuk opened a new pull request #6115: [AIRFLOW-5150] Implement POC for GitLab + Kubernetes tests URL: https://github.com/apache/airflow/pull/6115 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] codecov-io commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
codecov-io commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#issuecomment-531589540 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6104?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5453) Improve reading inputs from Dataflow console

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930038#comment-16930038 ] ASF GitHub Bot commented on AIRFLOW-5453: - potiuk commented on pull request #6073:

[GitHub] [airflow] feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324477112 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[jira] [Commented] (AIRFLOW-5484) PigCliHook has incorrect named parameter

2019-09-15 Thread Josue Esaud Gomez Gonzalez (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930081#comment-16930081 ] Josue Esaud Gomez Gonzalez commented on AIRFLOW-5484: - PigCliHook has incorrect

[GitHub] [airflow] potiuk merged pull request #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly

2019-09-15 Thread GitBox
potiuk merged pull request #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly URL: https://github.com/apache/airflow/pull/6036 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk commented on issue #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread GitBox
potiuk commented on issue #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar URL: https://github.com/apache/airflow/pull/6062#issuecomment-531589124 @mik-laj I assume you refer to: ``` resources: {} ``` I could not find how it works in this

[GitHub] [airflow] potiuk commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324475914 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[GitHub] [airflow] feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324477258 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[jira] [Resolved] (AIRFLOW-5476) Typo in BREEZE.rst

2019-09-15 Thread Lee Dongjin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lee Dongjin resolved AIRFLOW-5476. -- Resolution: Fixed > Typo in BREEZE.rst > -- > > Key:

[GitHub] [airflow] kaxil commented on a change in pull request #6101: [AIRFLOW-5481] Allow Deleting Renamed DAGs

2019-09-15 Thread GitBox
kaxil commented on a change in pull request #6101: [AIRFLOW-5481] Allow Deleting Renamed DAGs URL: https://github.com/apache/airflow/pull/6101#discussion_r324463012 ## File path: tests/core.py ## @@ -1696,6 +1696,15 @@ def test_delete_dag(self): '--yes'])

[jira] [Assigned] (AIRFLOW-5482) Deprecate Schedule Interval on task level

2019-09-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-5482: --- Assignee: Kaxil Naik > Deprecate Schedule Interval on task level >

[jira] [Commented] (AIRFLOW-5482) Deprecate Schedule Interval on task level

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929949#comment-16929949 ] ASF subversion and git services commented on AIRFLOW-5482: -- Commit

[jira] [Commented] (AIRFLOW-5482) Deprecate Schedule Interval on task level

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929950#comment-16929950 ] ASF subversion and git services commented on AIRFLOW-5482: -- Commit

[jira] [Resolved] (AIRFLOW-5482) Deprecate Schedule Interval on task level

2019-09-15 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5482. - Resolution: Fixed > Deprecate Schedule Interval on task level >

[GitHub] [airflow] kaxil merged pull request #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level

2019-09-15 Thread GitBox
kaxil merged pull request #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level URL: https://github.com/apache/airflow/pull/6103 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5482) Deprecate Schedule Interval on task level

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929948#comment-16929948 ] ASF GitHub Bot commented on AIRFLOW-5482: - kaxil commented on pull request #6103:

[GitHub] [airflow] mik-laj commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
mik-laj commented on issue #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#issuecomment-531545093 Can you also update documentation? https://airflow.readthedocs.io/en/latest/howto/connection/ssh.html

[GitHub] [airflow] clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-15 Thread GitBox
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-531572470 I'll construct a minimal example and try things out. The operator creating the dagrun does sound like what should

[GitHub] [airflow] codecov-io commented on issue #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level

2019-09-15 Thread GitBox
codecov-io commented on issue #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level URL: https://github.com/apache/airflow/pull/6103#issuecomment-531540124 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6103?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level

2019-09-15 Thread GitBox
codecov-io edited a comment on issue #6103: [AIRFLOW-5482] Deprecate Schedule Interval on task level URL: https://github.com/apache/airflow/pull/6103#issuecomment-531540124 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6103?src=pr=h1) Report > Merging

[GitHub] [airflow] tooptoop4 commented on issue #5639: [AIRFLOW-4883] Add missing code lost during rebase of original commit

2019-09-15 Thread GitBox
tooptoop4 commented on issue #5639: [AIRFLOW-4883] Add missing code lost during rebase of original commit URL: https://github.com/apache/airflow/pull/5639#issuecomment-531542823 @aoen can u look at https://stackoverflow.com/questions/57713394/airflow-scheduler-stuck ?

[GitHub] [airflow] feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
feluelle commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324453800 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[GitHub] [airflow] mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324467572 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[GitHub] [airflow] clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-15 Thread GitBox
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-531573202 All DAGs are Schedule: None and the parent is triggered externally with parameters using [the REST

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930163#comment-16930163 ] ASF GitHub Bot commented on AIRFLOW-5150: - potiuk commented on pull request #6115:

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930170#comment-16930170 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930177#comment-16930177 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324486045 ## File path: scripts/ci/kubernetes/docker/build.sh ## @@ -20,29 +20,14 @@ IMAGE=${IMAGE:-airflow}

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324486346 ## File path: Dockerfile ## @@ -85,6 +92,24 @@ RUN curl -sL https://deb.nodesource.com/setup_10.x | bash

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324486249 ## File path: Dockerfile ## @@ -372,4 +397,6 @@ EXPOSE 8080 ENTRYPOINT ["/usr/local/bin/dumb-init",

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930167#comment-16930167 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r324488944 ## File path: airflow/kubernetes/volume.py ## @@ -25,20

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r324488969 ## File path: airflow/kubernetes/volume.py ## @@ -25,20

[GitHub] [airflow] jasonlin2268 opened a new pull request #6116: Merge pull request #1 from apache/master

2019-09-15 Thread GitBox
jasonlin2268 opened a new pull request #6116: Merge pull request #1 from apache/master URL: https://github.com/apache/airflow/pull/6116 fix Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] dstandish commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
dstandish commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#discussion_r324483395 ## File path: airflow/contrib/hooks/ssh_hook.py ## @@ -160,24 +169,27 @@ def get_conn(self):

[GitHub] [airflow] dstandish commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
dstandish commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#discussion_r324483395 ## File path: airflow/contrib/hooks/ssh_hook.py ## @@ -160,24 +169,27 @@ def get_conn(self):

[GitHub] [airflow] potiuk commented on issue #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on issue #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#issuecomment-531608665 Hey @gerardo -> I think maybe you can take a look at running the dind image separately. It would be simplification and it will make the

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324486431 ## File path: scripts/ci/local_ci_stop_environment.sh ## @@ -45,7 +45,6 @@ export HOST_GROUP_ID

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930174#comment-16930174 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[jira] [Comment Edited] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-15 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930224#comment-16930224 ] Daniel Imberman edited comment on AIRFLOW-5447 at 9/16/19 4:21 AM: ---

[jira] [Commented] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-15 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930224#comment-16930224 ] Daniel Imberman commented on AIRFLOW-5447: -- [~Yuval.Itzchakov] [~cwegrzyn]Thank you guys for

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324486402 ## File path: scripts/ci/pylint_todo.txt ## @@ -462,8 +462,8 @@ ./tests/lineage/backend/test_atlas.py

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930168#comment-16930168 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[GitHub] [airflow] potiuk commented on issue #5976: [AIRFLOW-5369] Add interactivity to pre-commits

2019-09-15 Thread GitBox
potiuk commented on issue #5976: [AIRFLOW-5369] Add interactivity to pre-commits URL: https://github.com/apache/airflow/pull/5976#issuecomment-531610072 Hey @dimberman :)? This is an automated message from the Apache Git

[GitHub] [airflow] potiuk commented on issue #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes

2019-09-15 Thread GitBox
potiuk commented on issue #5786: [AIRFLOW-5170] [AIRFLOW-5256] Consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#issuecomment-531613726 @feluelle -> I think it will be green soon:)

[jira] [Resolved] (AIRFLOW-5453) Improve reading inputs from Dataflow console

2019-09-15 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5453. --- Fix Version/s: 2.0.0 Resolution: Fixed > Improve reading inputs from Dataflow

[GitHub] [airflow] potiuk commented on issue #6073: [AIRFLOW-5453] Improve reading inputs from Dataflow console

2019-09-15 Thread GitBox
potiuk commented on issue #6073: [AIRFLOW-5453] Improve reading inputs from Dataflow console URL: https://github.com/apache/airflow/pull/6073#issuecomment-531589265 Already merged in separate PR. This is an automated message

[GitHub] [airflow] potiuk closed pull request #6073: [AIRFLOW-5453] Improve reading inputs from Dataflow console

2019-09-15 Thread GitBox
potiuk closed pull request #6073: [AIRFLOW-5453] Improve reading inputs from Dataflow console URL: https://github.com/apache/airflow/pull/6073 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086#discussion_r324476450 ## File path: docs/integration.rst ## @@ -237,230 +235,290 @@ Airflow can be configured to read and

[GitHub] [airflow] adankro opened a new pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
adankro opened a new pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930082#comment-16930082 ] ASF GitHub Bot commented on AIRFLOW-5495: - adankro commented on pull request #6105:

[GitHub] [airflow] adankro commented on issue #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
adankro commented on issue #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105#issuecomment-531598199 @jghoman This is an automated message from the Apache Git

[GitHub] [airflow] jghoman commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
jghoman commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105#discussion_r324480968 ## File path: airflow/gcp/operators/dataproc.py ## @@ -407,7 +407,7 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6104: [AIRFLOW-4574] allow providing private_key in SSHHook URL: https://github.com/apache/airflow/pull/6104#discussion_r324481025 ## File path: airflow/contrib/hooks/ssh_hook.py ## @@ -160,24 +169,27 @@ def get_conn(self):

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324481094 ## File path: Dockerfile ## @@ -18,6 +18,8 @@ # Base image for the whole Docker file ARG

[GitHub] [airflow] mik-laj commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
mik-laj commented on a change in pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105#discussion_r324481153 ## File path: airflow/gcp/operators/dataproc.py ## @@ -407,7 +407,7 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324481177 ## File path: Dockerfile ## @@ -33,6 +35,9 @@ ENV PYTHON_BASE_IMAGE=${PYTHON_BASE_IMAGE} ARG

[GitHub] [airflow] jghoman merged pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
jghoman merged pull request #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930091#comment-16930091 ] ASF subversion and git services commented on AIRFLOW-5495: -- Commit

[jira] [Commented] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930092#comment-16930092 ] ASF subversion and git services commented on AIRFLOW-5495: -- Commit

[jira] [Commented] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930090#comment-16930090 ] ASF subversion and git services commented on AIRFLOW-5495: -- Commit

[jira] [Commented] (AIRFLOW-5495) Remove unneeded parens in dataproc.py

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930089#comment-16930089 ] ASF GitHub Bot commented on AIRFLOW-5495: - jghoman commented on pull request #6105:

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324481317 ## File path: Dockerfile ## @@ -51,11 +56,13 @@ RUN apt-get update \ && apt-get install -y

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324481094 ## File path: Dockerfile ## @@ -18,6 +18,8 @@ # Base image for the whole Docker file ARG

[GitHub] [airflow] potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI

2019-09-15 Thread GitBox
potiuk commented on a change in pull request #5837: [AIRFLOW-5223] Use KinD for Kubernetes in CI URL: https://github.com/apache/airflow/pull/5837#discussion_r324481380 ## File path: Dockerfile ## @@ -85,6 +92,24 @@ RUN curl -sL https://deb.nodesource.com/setup_10.x | bash

[GitHub] [airflow] mik-laj merged pull request #6078: [AIRFLOW-5459] Use a dynamic tmp location in Dataflow operator

2019-09-15 Thread GitBox
mik-laj merged pull request #6078: [AIRFLOW-5459] Use a dynamic tmp location in Dataflow operator URL: https://github.com/apache/airflow/pull/6078 This is an automated message from the Apache Git Service. To respond to the

[jira] [Closed] (AIRFLOW-5459) use a dynamic tmp location in dataflow operator

2019-09-15 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5459. -- Resolution: Fixed > use a dynamic tmp location in dataflow operator >

[jira] [Commented] (AIRFLOW-5459) use a dynamic tmp location in dataflow operator

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930093#comment-16930093 ] ASF GitHub Bot commented on AIRFLOW-5459: - mik-laj commented on pull request #6078:

[jira] [Commented] (AIRFLOW-5459) use a dynamic tmp location in dataflow operator

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930094#comment-16930094 ] ASF subversion and git services commented on AIRFLOW-5459: -- Commit

[jira] [Commented] (AIRFLOW-5445) Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930095#comment-16930095 ] ASF GitHub Bot commented on AIRFLOW-5445: - mik-laj commented on pull request #6062:

[GitHub] [airflow] mik-laj commented on issue #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread GitBox
mik-laj commented on issue #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar URL: https://github.com/apache/airflow/pull/6062#issuecomment-531600031 I checked carefully and `resource: {}` does not work properly.

[GitHub] [airflow] mik-laj merged pull request #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread GitBox
mik-laj merged pull request #6062: [AIRFLOW-5445] Reduce the required resources for the Kubernetes's sidecar URL: https://github.com/apache/airflow/pull/6062 This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-5489) bash_senor: Remove unneeded assignment of variable

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930097#comment-16930097 ] ASF GitHub Bot commented on AIRFLOW-5489: - getras1998 commented on pull request #6106:

[jira] [Closed] (AIRFLOW-5445) Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5445. -- Fix Version/s: 1.10.6 Resolution: Fixed > Reduce the required resources for the

[jira] [Commented] (AIRFLOW-5445) Reduce the required resources for the Kubernetes's sidecar

2019-09-15 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930096#comment-16930096 ] ASF subversion and git services commented on AIRFLOW-5445: -- Commit

[GitHub] [airflow] getras1998 opened a new pull request #6106: [AIRFLOW-5489] Remove unneeded assignment of variable

2019-09-15 Thread GitBox
getras1998 opened a new pull request #6106: [AIRFLOW-5489] Remove unneeded assignment of variable URL: https://github.com/apache/airflow/pull/6106 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] getras1998 commented on issue #6106: [AIRFLOW-5489] Remove unneeded assignment of variable

2019-09-15 Thread GitBox
getras1998 commented on issue #6106: [AIRFLOW-5489] Remove unneeded assignment of variable URL: https://github.com/apache/airflow/pull/6106#issuecomment-531600315 @jghoman This is an automated message from the Apache Git

[GitHub] [airflow] codecov-io commented on issue #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py

2019-09-15 Thread GitBox
codecov-io commented on issue #6105: [AIRFLOW-5495] Remove unneeded parens in dataproc.py URL: https://github.com/apache/airflow/pull/6105#issuecomment-531600949 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6105?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5492) Missing docstring for hive .py

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930105#comment-16930105 ] ASF GitHub Bot commented on AIRFLOW-5492: - pedroortizm commented on pull request #6107:

[GitHub] [airflow] mik-laj merged pull request #6086: [AIRFLOW-XXX] Display GCP integration in table

2019-09-15 Thread GitBox
mik-laj merged pull request #6086: [AIRFLOW-XXX] Display GCP integration in table URL: https://github.com/apache/airflow/pull/6086 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] pedroortizm opened a new pull request #6107: [AIRFLOW-5492] added missing docstrings

2019-09-15 Thread GitBox
pedroortizm opened a new pull request #6107: [AIRFLOW-5492] added missing docstrings URL: https://github.com/apache/airflow/pull/6107 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] pedroortizm commented on issue #6107: [AIRFLOW-5492] added missing docstrings

2019-09-15 Thread GitBox
pedroortizm commented on issue #6107: [AIRFLOW-5492] added missing docstrings URL: https://github.com/apache/airflow/pull/6107#issuecomment-531601283 @jghoman This is an automated message from the Apache Git Service. To

[GitHub] [airflow] Mordeck opened a new pull request #6108: [AIRFLOW-5491] mark_tasks pydoc is incorrect

2019-09-15 Thread GitBox
Mordeck opened a new pull request #6108: [AIRFLOW-5491] mark_tasks pydoc is incorrect URL: https://github.com/apache/airflow/pull/6108 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj merged pull request #6108: [AIRFLOW-5491] mark_tasks pydoc is incorrect

2019-09-15 Thread GitBox
mik-laj merged pull request #6108: [AIRFLOW-5491] mark_tasks pydoc is incorrect URL: https://github.com/apache/airflow/pull/6108 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-5491) mark_tasks pydoc is incorrect

2019-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930107#comment-16930107 ] ASF GitHub Bot commented on AIRFLOW-5491: - mik-laj commented on pull request #6108:

  1   2   >