[jira] [Resolved] (AIRFLOW-5368) Display DAG from the CLI

2019-09-07 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5368. --- Fix Version/s: 1.10.6 Resolution: Fixed > Display DAG from the CLI >

[GitHub] [airflow] mik-laj commented on a change in pull request #5975: [AIRFLOW-5368] Display DAG from the CLI

2019-09-07 Thread GitBox
mik-laj commented on a change in pull request #5975: [AIRFLOW-5368] Display DAG from the CLI URL: https://github.com/apache/airflow/pull/5975#discussion_r321975084 ## File path: setup.py ## @@ -340,6 +340,7 @@ def do_setup(): 'flask-swagger==0.2.13',

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529124619 And I noticed check_links.sh has no +x flag set. This is an

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529124692 And if we make it as pre-commit we should make lynx a requirement

[GitHub] [airflow] mik-laj commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#discussion_r321976157 ## File path: .pre-commit-config.yaml ## @@ -167,7 +167,7 @@ repos: language:

[GitHub] [airflow] mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529126461 This script checks generated HTML files, not rst files. RST files do not contain all links because a large number of links

[GitHub] [airflow] mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529126325 We can probably optimize this script, but I'm afraid we will generate unnecessary noise. Websites often do not work stably if

[GitHub] [airflow] steven-freed edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-07 Thread GitBox
steven-freed edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-529121895 git remote show origin is saying all branches are tracked and my master is up to date. Heres a link to my fork and

[GitHub] [airflow] mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529133295 In the absence of a lynx a message is displayed informing about this fact. The lack of compatibility with Mac OS seems to me

[GitHub] [airflow] potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-07 Thread GitBox
potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-529091883 This is the error from Travis. So it does seem to be related to your change. What I recommend - setup Breeze (see BREEZE.rst) and try

[jira] [Created] (AIRFLOW-5433) Add script to check external links in docs

2019-09-07 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5433: -- Summary: Add script to check external links in docs Key: AIRFLOW-5433 URL: https://issues.apache.org/jira/browse/AIRFLOW-5433 Project: Apache Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6039: [AIRFLOW-XXX] Add S3 Logging section to integration.rst

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6039: [AIRFLOW-XXX] Add S3 Logging section to integration.rst URL: https://github.com/apache/airflow/pull/6039 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6038: [AIRFLOW-XXX] Add autogenerated TOC in integration.rst

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6038: [AIRFLOW-XXX] Add autogenerated TOC in integration.rst URL: https://github.com/apache/airflow/pull/6038 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529124619 And I noticed check_links.sh has no +x flag set (that's why you probably had to add it to shellcheck files).

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529125186 One more comment - readarray does not work on Mac. So we should really make those changes: - move it to in_container dir

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529126721 Ok. That makes it more difficult then as even if we add .py files then we have no way to generate the list of files. Then we

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529126778 And you can make it part of the docs_build script actually.

[jira] [Created] (AIRFLOW-5437) When you run Breeze, no matter what image is build python 3 from check

2019-09-07 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-5437: - Summary: When you run Breeze, no matter what image is build python 3 from check Key: AIRFLOW-5437 URL: https://issues.apache.org/jira/browse/AIRFLOW-5437 Project:

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529143046 At my training in NYC we had 1 (!) person using linux. All other people (about 20 of them) were using MacOS. It's not a rare

[GitHub] [airflow] mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529143180 I added Docker integration and lynx to dockerfile. This is

[GitHub] [airflow] mik-laj commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#discussion_r321981940 ## File path: Dockerfile ## @@ -62,7 +62,6 @@ RUN curl -sL

[GitHub] [airflow] mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529143323 I had integration with Travis cron, but I deleted because first we need to solve the problems that this script reports.

[GitHub] [airflow] potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#discussion_r321982061 ## File path: docs/check_links.sh ## @@ -47,6 +48,37 @@ echo echo "Working in ${MY_DIR}

[GitHub] [airflow] potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#discussion_r321982269 ## File path: scripts/ci/ci_check_links.sh ## @@ -0,0 +1,39 @@ +#!/usr/bin/env bash

[GitHub] [airflow] potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#discussion_r321982308 ## File path: Dockerfile ## @@ -62,7 +62,6 @@ RUN curl -sL

[GitHub] [airflow] potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk commented on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529144721 > I had integration with Travis cron, but I deleted because first we need to solve the problems that this script reports.

[GitHub] [airflow] potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529144721 > I had integration with Travis cron, but I deleted because first we need to solve the problems that this script

[GitHub] [airflow] potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529143046 At my training in NYC we had 1 (!) person using linux. All other people (about 20 of them) were using MacOS. It's not a

[GitHub] [airflow] potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
potiuk edited a comment on issue #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045#issuecomment-529143046 At my training in NYC we had 1 (!) person using linux. All other people (about 20 of them) were using MacOS. It's not a

[GitHub] [airflow] potiuk opened a new pull request #6053: [AIRFLOW-5437] Do not override python when you rebuild ci_slim image

2019-09-07 Thread GitBox
potiuk opened a new pull request #6053: [AIRFLOW-5437] Do not override python when you rebuild ci_slim image URL: https://github.com/apache/airflow/pull/6053 Make sure you have checked _all_ steps below. Yet another issue with overriding python version for breeze. I made it

[jira] [Commented] (AIRFLOW-5437) When you run Breeze, no matter what image is build python 3 from check

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924980#comment-16924980 ] ASF GitHub Bot commented on AIRFLOW-5437: - potiuk commented on pull request #6053:

[jira] [Updated] (AIRFLOW-5437) When you run Breeze, no matter what image is build python 3.5 from checks overrides run version

2019-09-07 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5437: -- Summary: When you run Breeze, no matter what image is build python 3.5 from checks overrides

[GitHub] [airflow] abhi9866 removed a comment on issue #5707: [AIRFLOW-4462] Use datetime2 column types when using MSSQL backend

2019-09-07 Thread GitBox
abhi9866 removed a comment on issue #5707: [AIRFLOW-4462] Use datetime2 column types when using MSSQL backend URL: https://github.com/apache/airflow/pull/5707#issuecomment-529029517 @sirVir There still seems to be issue when triggering dag from UI using MSSQL as backend. I don't see any

[GitHub] [airflow] KevinYang21 commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-07 Thread GitBox
KevinYang21 commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#discussion_r321985815 ## File path: tests/utils/test_dag_processing.py ## @@ -169,6 +179,126 @@

[GitHub] [airflow] KevinYang21 commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-07 Thread GitBox
KevinYang21 commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#discussion_r321986407 ## File path: airflow/utils/dag_processing.py ## @@ -1193,13 +1195,11 @@

[GitHub] [airflow] mik-laj opened a new pull request #6043: [AIRFLOW-XXX] Simplify Qubole operators listing

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6043: [AIRFLOW-XXX] Simplify Qubole operators listing URL: https://github.com/apache/airflow/pull/6043 This issue is one of a series about restructuring integration.rst https://issues.apache.org/jira/browse/AIRFLOW-5431 --- Make sure you

[jira] [Commented] (AIRFLOW-5430) airflow initdb is broken on py2 and py3.5 due to transitive dependency

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924810#comment-16924810 ] ASF GitHub Bot commented on AIRFLOW-5430: - potiuk commented on pull request #6037:

[GitHub] [airflow] potiuk merged pull request #6037: [AIRFLOW-5430] Pin transitive dependency on marshmallow-sqlalchemy

2019-09-07 Thread GitBox
potiuk merged pull request #6037: [AIRFLOW-5430] Pin transitive dependency on marshmallow-sqlalchemy URL: https://github.com/apache/airflow/pull/6037 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-5430) airflow initdb is broken on py2 and py3.5 due to transitive dependency

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924811#comment-16924811 ] ASF subversion and git services commented on AIRFLOW-5430: -- Commit

[GitHub] [airflow] mik-laj opened a new pull request #6045: [AIRFLOW-5433] Add script to check external links in docs

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6045: [AIRFLOW-5433] Add script to check external links in docs URL: https://github.com/apache/airflow/pull/6045 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5433) Add script to check external links in docs

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924833#comment-16924833 ] ASF GitHub Bot commented on AIRFLOW-5433: - mik-laj commented on pull request #6045:

[GitHub] [airflow] potiuk commented on a change in pull request #5944: [AIRFLOW-5362] Reorder imports

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #5944: [AIRFLOW-5362] Reorder imports URL: https://github.com/apache/airflow/pull/5944#discussion_r321962777 ## File path: .pre-commit-config.yaml ## @@ -190,8 +190,16 @@ repos: language: system entry:

[GitHub] [airflow] potiuk commented on a change in pull request #5944: [AIRFLOW-5362] Reorder imports

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #5944: [AIRFLOW-5362] Reorder imports URL: https://github.com/apache/airflow/pull/5944#discussion_r321962777 ## File path: .pre-commit-config.yaml ## @@ -190,8 +190,16 @@ repos: language: system entry:

[GitHub] [airflow] mik-laj opened a new pull request #6040: [AIRFLOW-XXX] Move Azure Logging section above operators in integration.rst

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6040: [AIRFLOW-XXX] Move Azure Logging section above operators in integration.rst URL: https://github.com/apache/airflow/pull/6040 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6041: [AIRFLOW-XXX] Improve docstring of SQSHook

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6041: [AIRFLOW-XXX] Improve docstring of SQSHook URL: https://github.com/apache/airflow/pull/6041 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] potiuk merged pull request #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-07 Thread GitBox
potiuk merged pull request #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk edited a comment on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-07 Thread GitBox
potiuk edited a comment on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022#issuecomment-529091509 Thanks! @leahecole for contributing. Nice to hear Breeze is being used :)

[GitHub] [airflow] potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-07 Thread GitBox
potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022#issuecomment-529091509 Thanks! @leahecole for contributing. Lucky to hear Breeze is being used :)

[jira] [Created] (AIRFLOW-5432) Remove colour logs from UI

2019-09-07 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5432: Summary: Remove colour logs from UI Key: AIRFLOW-5432 URL: https://issues.apache.org/jira/browse/AIRFLOW-5432 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-5431) Restructuring integration.rst

2019-09-07 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5431: -- Summary: Restructuring integration.rst Key: AIRFLOW-5431 URL: https://issues.apache.org/jira/browse/AIRFLOW-5431 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mik-laj opened a new pull request #6042: [AIRFLOW-XXX] Add note about GKEPodOperator in KubernetesPodOperator

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6042: [AIRFLOW-XXX] Add note about GKEPodOperator in KubernetesPodOperator URL: https://github.com/apache/airflow/pull/6042 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6044: [AIRFLOW-XXX] Simplify GCP operators listing

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6044: [AIRFLOW-XXX] Simplify GCP operators listing URL: https://github.com/apache/airflow/pull/6044 This issue is one of a series about restructuring integration.rst https://issues.apache.org/jira/browse/AIRFLOW-5431 --- Make sure you

[GitHub] [airflow] KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-07 Thread GitBox
KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-529098410 Added the fix as another commit to make clear seperation on the revert commit and the actual fix commit.

[jira] [Updated] (AIRFLOW-5431) Restructuring integration.rst

2019-09-07 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5431: --- Description:   Hey. I would like to restructure the "integration.rst" page today. In my

[GitHub] [airflow] mik-laj merged pull request #6040: [AIRFLOW-XXX] Move Azure Logging section above operators in integration.rst

2019-09-07 Thread GitBox
mik-laj merged pull request #6040: [AIRFLOW-XXX] Move Azure Logging section above operators in integration.rst URL: https://github.com/apache/airflow/pull/6040 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] mik-laj merged pull request #6038: [AIRFLOW-XXX] Add autogenerated TOC in integration.rst

2019-09-07 Thread GitBox
mik-laj merged pull request #6038: [AIRFLOW-XXX] Add autogenerated TOC in integration.rst URL: https://github.com/apache/airflow/pull/6038 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] mik-laj merged pull request #6039: [AIRFLOW-XXX] Add S3 Logging section to integration.rst

2019-09-07 Thread GitBox
mik-laj merged pull request #6039: [AIRFLOW-XXX] Add S3 Logging section to integration.rst URL: https://github.com/apache/airflow/pull/6039 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] nuclearpinguin opened a new pull request #6046: [AIRFLOW-5432] Remove colour logs from UI

2019-09-07 Thread GitBox
nuclearpinguin opened a new pull request #6046: [AIRFLOW-5432] Remove colour logs from UI URL: https://github.com/apache/airflow/pull/6046 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Assigned] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-09-07 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sayed Mohammad Hossein Torabi reassigned AIRFLOW-5415: -- Assignee: Sayed Mohammad Hossein Torabi > Druid

[jira] [Created] (AIRFLOW-5434) Use hook to provide credentials in GKEPodOperator

2019-09-07 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5434: -- Summary: Use hook to provide credentials in GKEPodOperator Key: AIRFLOW-5434 URL: https://issues.apache.org/jira/browse/AIRFLOW-5434 Project: Apache Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6050: [AIRFLOW-5434] Use hook to provide credentials in GKEPodOperator

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6050: [AIRFLOW-5434] Use hook to provide credentials in GKEPodOperator URL: https://github.com/apache/airflow/pull/6050 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on issue #6050: [AIRFLOW-5434][DONT-MERGE] Use hook to provide credentials in GKEPodOperator

2019-09-07 Thread GitBox
mik-laj commented on issue #6050: [AIRFLOW-5434][DONT-MERGE] Use hook to provide credentials in GKEPodOperator URL: https://github.com/apache/airflow/pull/6050#issuecomment-529115287 I am wondering about the optional ``gcp_conn_id`` parameter. It was optional. Now it's required. When the

[jira] [Created] (AIRFLOW-5436) Remove log from init in BigQuery operators

2019-09-07 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5436: -- Summary: Remove log from init in BigQuery operators Key: AIRFLOW-5436 URL: https://issues.apache.org/jira/browse/AIRFLOW-5436 Project: Apache Airflow

[GitHub] [airflow] potiuk merged pull request #6030: [AIRFLOW-5424] Type annotations for GCP hooks

2019-09-07 Thread GitBox
potiuk merged pull request #6030: [AIRFLOW-5424] Type annotations for GCP hooks URL: https://github.com/apache/airflow/pull/6030 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk merged pull request #6046: [AIRFLOW-5432] Remove colour logs from UI

2019-09-07 Thread GitBox
potiuk merged pull request #6046: [AIRFLOW-5432] Remove colour logs from UI URL: https://github.com/apache/airflow/pull/6046 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk merged pull request #5975: [AIRFLOW-5368] Display DAG from the CLI

2019-09-07 Thread GitBox
potiuk merged pull request #5975: [AIRFLOW-5368] Display DAG from the CLI URL: https://github.com/apache/airflow/pull/5975 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-5368) Display DAG from the CLI

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924933#comment-16924933 ] ASF subversion and git services commented on AIRFLOW-5368: -- Commit

[jira] [Commented] (AIRFLOW-5368) Display DAG from the CLI

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924932#comment-16924932 ] ASF GitHub Bot commented on AIRFLOW-5368: - potiuk commented on pull request #5975:

[GitHub] [airflow] steven-freed edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-07 Thread GitBox
steven-freed edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-529121895 git remote show origin is saying all branches are tracked and my master is up to date. Heres a link to my fork and

[jira] [Commented] (AIRFLOW-5432) Remove colour logs from UI

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924855#comment-16924855 ] ASF GitHub Bot commented on AIRFLOW-5432: - nuclearpinguin commented on pull request #6046:

[jira] [Commented] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-09-07 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924878#comment-16924878 ] Sayed Mohammad Hossein Torabi commented on AIRFLOW-5415: [~scrawfo] I saw it!

[GitHub] [airflow] seelmann commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-07 Thread GitBox
seelmann commented on a change in pull request #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#discussion_r321969740 ## File path: tests/utils/test_dag_processing.py ## @@ -169,6 +179,126 @@

[jira] [Commented] (AIRFLOW-5434) Use hook to provide credentials in GKEPodOperator

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924889#comment-16924889 ] ASF GitHub Bot commented on AIRFLOW-5434: - mik-laj commented on pull request #6050:

[jira] [Created] (AIRFLOW-5435) Add fallback for connection's project id in GKEPodOperator

2019-09-07 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5435: -- Summary: Add fallback for connection's project id in GKEPodOperator Key: AIRFLOW-5435 URL: https://issues.apache.org/jira/browse/AIRFLOW-5435 Project: Apache

[GitHub] [airflow] mik-laj commented on issue #6044: [AIRFLOW-XXX] Simplify GCP operators listing

2019-09-07 Thread GitBox
mik-laj commented on issue #6044: [AIRFLOW-XXX] Simplify GCP operators listing URL: https://github.com/apache/airflow/pull/6044#issuecomment-529118515 I am afraid of conflicts during my changes, so I divide my work into smaller pieces.

[GitHub] [airflow] mik-laj edited a comment on issue #6044: [AIRFLOW-XXX] Simplify GCP operators listing

2019-09-07 Thread GitBox
mik-laj edited a comment on issue #6044: [AIRFLOW-XXX] Simplify GCP operators listing URL: https://github.com/apache/airflow/pull/6044#issuecomment-529118515 I am afraid of conflicts during my changes, so I divide my work into smaller pieces. It also makes review easier because the

[GitHub] [airflow] potiuk commented on a change in pull request #5975: [AIRFLOW-5368] Display DAG from the CLI

2019-09-07 Thread GitBox
potiuk commented on a change in pull request #5975: [AIRFLOW-5368] Display DAG from the CLI URL: https://github.com/apache/airflow/pull/5975#discussion_r321974459 ## File path: setup.py ## @@ -340,6 +340,7 @@ def do_setup(): 'flask-swagger==0.2.13',

[GitHub] [airflow] mik-laj opened a new pull request #6047: [AIRFLOW-XXX] Simplify AWS/Azure/Databricks operators listing

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6047: [AIRFLOW-XXX] Simplify AWS/Azure/Databricks operators listing URL: https://github.com/apache/airflow/pull/6047 This issue is one of a series about restructuring integration.rst https://issues.apache.org/jira/browse/AIRFLOW-5431 ---

[jira] [Resolved] (AIRFLOW-5430) airflow initdb is broken on py2 and py3.5 due to transitive dependency

2019-09-07 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5430. --- Fix Version/s: 1.10.6 Resolution: Fixed > airflow initdb is broken on py2 and py3.5

[GitHub] [airflow] mik-laj opened a new pull request #6051: [AIRFLOW-5435][depends on AIRFLOW-5434] Add fallback for connection's project id in GKEPodOperator

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6051: [AIRFLOW-5435][depends on AIRFLOW-5434] Add fallback for connection's project id in GKEPodOperator URL: https://github.com/apache/airflow/pull/6051 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the

[GitHub] [airflow] mik-laj opened a new pull request #6052: [AIRFLOW-5436] Remove log from init in BigQuery operators

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6052: [AIRFLOW-5436] Remove log from init in BigQuery operators URL: https://github.com/apache/airflow/pull/6052 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] potiuk merged pull request #5957: [AIRFLOW-3511][AIRFLOW-3512] Add Cloud Memorystore integration

2019-09-07 Thread GitBox
potiuk merged pull request #5957: [AIRFLOW-3511][AIRFLOW-3512] Add Cloud Memorystore integration URL: https://github.com/apache/airflow/pull/5957 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-5436) Remove log from init in BigQuery operators

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924897#comment-16924897 ] ASF GitHub Bot commented on AIRFLOW-5436: - mik-laj commented on pull request #6052:

[GitHub] [airflow] potiuk merged pull request #6044: [AIRFLOW-XXX] Simplify GCP operators listing

2019-09-07 Thread GitBox
potiuk merged pull request #6044: [AIRFLOW-XXX] Simplify GCP operators listing URL: https://github.com/apache/airflow/pull/6044 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (AIRFLOW-5375) Airflow 1.10.4 doesn`t installing on windows

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924921#comment-16924921 ] ASF GitHub Bot commented on AIRFLOW-5375: - potiuk commented on pull request #6009:

[GitHub] [airflow] potiuk merged pull request #6009: [AIRFLOW-5375] Move dumb-init to devel requirements

2019-09-07 Thread GitBox
potiuk merged pull request #6009: [AIRFLOW-5375] Move dumb-init to devel requirements URL: https://github.com/apache/airflow/pull/6009 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-07 Thread GitBox
potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-529119673 Can you provide a link ? Are you rebased onto most recent apache/master ?

[GitHub] [airflow] potiuk edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-07 Thread GitBox
potiuk edited a comment on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-529119673 Can you please provide a link ? Are you rebased onto most recent apache/master ?

[jira] [Commented] (AIRFLOW-5375) Airflow 1.10.4 doesn`t installing on windows

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924922#comment-16924922 ] ASF subversion and git services commented on AIRFLOW-5375: -- Commit

[jira] [Commented] (AIRFLOW-5375) Airflow 1.10.4 doesn`t installing on windows

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924929#comment-16924929 ] ASF subversion and git services commented on AIRFLOW-5375: -- Commit

[jira] [Resolved] (AIRFLOW-5375) Airflow 1.10.4 doesn`t installing on windows

2019-09-07 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5375. --- Fix Version/s: 1.10.6 Resolution: Fixed > Airflow 1.10.4 doesn`t installing on

[jira] [Commented] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-09-07 Thread Steve Crawford (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924868#comment-16924868 ] Steve Crawford commented on AIRFLOW-5415: - Hi Sayed, I should of put this in the description. I

[GitHub] [airflow] mik-laj opened a new pull request #6048: [AIRFLOW-XXX] Add external refernece to all GCP operator guide

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6048: [AIRFLOW-XXX] Add external refernece to all GCP operator guide URL: https://github.com/apache/airflow/pull/6048 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj opened a new pull request #6049: [AIRFLOW-XXX] Add prerequisite tasks for all GCP operators

2019-09-07 Thread GitBox
mik-laj opened a new pull request #6049: [AIRFLOW-XXX] Add prerequisite tasks for all GCP operators URL: https://github.com/apache/airflow/pull/6049 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5430) airflow initdb is broken on py2 and py3.5 due to transitive dependency

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924893#comment-16924893 ] ASF subversion and git services commented on AIRFLOW-5430: -- Commit

[jira] [Commented] (AIRFLOW-5435) Add fallback for connection's project id in GKEPodOperator

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924892#comment-16924892 ] ASF GitHub Bot commented on AIRFLOW-5435: - mik-laj commented on pull request #6051:

[jira] [Commented] (AIRFLOW-5416) Simplify the process of continually developing airflow-on-k8s images

2019-09-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924896#comment-16924896 ] ASF GitHub Bot commented on AIRFLOW-5416: - potiuk commented on pull request #6021:

[GitHub] [airflow] potiuk merged pull request #6021: [AIRFLOW-5416] pre-load requirements for airflow image

2019-09-07 Thread GitBox
potiuk merged pull request #6021: [AIRFLOW-5416] pre-load requirements for airflow image URL: https://github.com/apache/airflow/pull/6021 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (AIRFLOW-5401) Add support for project_id from connection in GKE

2019-09-07 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5401. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add support for project_id from connection

[jira] [Commented] (AIRFLOW-5401) Add support for project_id from connection in GKE

2019-09-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924903#comment-16924903 ] ASF subversion and git services commented on AIRFLOW-5401: -- Commit

  1   2   >