[GitHub] [airflow] mik-laj opened a new pull request #5817: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website (#5763)

2019-08-14 Thread GitBox
mik-laj opened a new pull request #5817: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website (#5763) URL: https://github.com/apache/airflow/pull/5817 # The discussion begins in PR: https://github.com/apache/airflow/pull/5763 Make sure you have checked _all_

[GitHub] [airflow] aijamalnk edited a comment on issue #5763: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website

2019-08-14 Thread GitBox
aijamalnk edited a comment on issue #5763: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website URL: https://github.com/apache/airflow/pull/5763#issuecomment-520946607 Hi @mik-laj , As Kaxil said, it was my request and I can answer all of your questions. First of all,

[GitHub] [airflow] aijamalnk edited a comment on issue #5763: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website

2019-08-14 Thread GitBox
aijamalnk edited a comment on issue #5763: [AIRFLOW-5148] Add Google Analytics to the Airflow doc website URL: https://github.com/apache/airflow/pull/5763#issuecomment-520946607 Hi @mik-laj , As Kaxil said, it was my request and I can answer all of your questions. First of all,

[jira] [Commented] (AIRFLOW-5148) Add Google Analytics to the Airflow doc website

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906971#comment-16906971 ] ASF GitHub Bot commented on AIRFLOW-5148: - mik-laj commented on pull request #5817:

[GitHub] [airflow] tkaymak commented on a change in pull request #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once

2019-08-14 Thread GitBox
tkaymak commented on a change in pull request #5685: [AIRFLOW-5072] gcs_hook's download() method should download only once URL: https://github.com/apache/airflow/pull/5685#discussion_r313721113 ## File path: airflow/contrib/hooks/gcs_hook.py ## @@ -172,8 +172,9 @@ def

[GitHub] [airflow] haoliang7 commented on issue #5495: [AIRFLOW-4858] Deprecate "Historical convenience functions" in conf

2019-08-14 Thread GitBox
haoliang7 commented on issue #5495: [AIRFLOW-4858] Deprecate "Historical convenience functions" in conf URL: https://github.com/apache/airflow/pull/5495#issuecomment-521128165 @ashb The old config methods are removed. Please review my last commit.

[GitHub] [airflow] ashb commented on a change in pull request #5789: [AIRFLOW-4222] Add cli autocomplete for bash & zsh

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5789: [AIRFLOW-4222] Add cli autocomplete for bash & zsh URL: https://github.com/apache/airflow/pull/5789#discussion_r313771624 ## File path: docs/howto/cli-completion.rst ## @@ -0,0 +1,42 @@ +.. Licensed to the Apache Software

[GitHub] [airflow] mik-laj merged pull request #5546: [AIRFLOW-4908] BigQuery Hooks/Operators for update_dataset, patch_dataset, get_dataset

2019-08-14 Thread GitBox
mik-laj merged pull request #5546: [AIRFLOW-4908] BigQuery Hooks/Operators for update_dataset, patch_dataset, get_dataset URL: https://github.com/apache/airflow/pull/5546 This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-4908) Implement BigQuery Hooks/Operators for update_dataset, patch_dataset and get_dataset

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907068#comment-16907068 ] ASF subversion and git services commented on AIRFLOW-4908: -- Commit

[jira] [Commented] (AIRFLOW-4908) Implement BigQuery Hooks/Operators for update_dataset, patch_dataset and get_dataset

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907067#comment-16907067 ] ASF GitHub Bot commented on AIRFLOW-4908: - mik-laj commented on pull request #5546:

[jira] [Created] (AIRFLOW-5212) Getting the error "ERROR - Failed to bag_dag"

2019-08-14 Thread Theepan Subramani (JIRA)
Theepan Subramani created AIRFLOW-5212: -- Summary: Getting the error "ERROR - Failed to bag_dag" Key: AIRFLOW-5212 URL: https://issues.apache.org/jira/browse/AIRFLOW-5212 Project: Apache Airflow

[GitHub] [airflow] BasPH commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
BasPH commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#discussion_r313817805 ## File path: airflow/models/baseoperator.py ## @@ -717,26 +717,27 @@ def

[GitHub] [airflow] acordiner commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator)

2019-08-14 Thread GitBox
acordiner commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator) URL: https://github.com/apache/airflow/pull/5489#issuecomment-521226654 This is great! Any chance to add the ability to pass extra arguments to the TaskTemplate and ContainerSpec? For

[GitHub] [airflow] dossett commented on issue #5419: [AIRFLOW-XXXX] Update pydoc of mlengine_operator

2019-08-14 Thread GitBox
dossett commented on issue #5419: [AIRFLOW-] Update pydoc of mlengine_operator URL: https://github.com/apache/airflow/pull/5419#issuecomment-521474769 Thanks @mik-laj, comment updated This is an automated message from

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314102570 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521460427 @ashb @dimberman This is an automated message from the

[jira] [Commented] (AIRFLOW-5215) Add sidecar container support to Pod object

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907695#comment-16907695 ] ASF GitHub Bot commented on AIRFLOW-5215: - pgagnon commented on pull request #5824:

[GitHub] [airflow] darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-14 Thread GitBox
darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825 ### Jira - [x] My PR addresses the following [Airflow Jira] - https://issues.apache.org/jira/browse/AIRFLOW-5218 ###

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907774#comment-16907774 ] Darren Weber commented on AIRFLOW-5218: --- There is something weird in the polling logs.  The

[GitHub] [airflow] potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks

2019-08-14 Thread GitBox
potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks URL: https://github.com/apache/airflow/pull/5777 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907710#comment-16907710 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907709#comment-16907709 ] ASF GitHub Bot commented on AIRFLOW-5161: - potiuk commented on pull request #5777:

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:04 AM: Even

[jira] [Created] (AIRFLOW-5219) Alarm if the task is not executed within the expected time range.

2019-08-14 Thread huangyan (JIRA)
huangyan created AIRFLOW-5219: - Summary: Alarm if the task is not executed within the expected time range. Key: AIRFLOW-5219 URL: https://issues.apache.org/jira/browse/AIRFLOW-5219 Project: Apache

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521466853 Test failure seems unrelated. This is an automated message

[GitHub] [airflow] derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases

2019-08-14 Thread GitBox
derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases URL: https://github.com/apache/airflow/pull/5826 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira] -

[GitHub] [airflow] mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section

2019-08-14 Thread GitBox
mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section URL: https://github.com/apache/airflow/pull/5776 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page

2019-08-14 Thread GitBox
mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page URL: https://github.com/apache/airflow/pull/5823 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5217) Fix Pod docstring

2019-08-14 Thread Philippe Gagnon (JIRA)
Philippe Gagnon created AIRFLOW-5217: Summary: Fix Pod docstring Key: AIRFLOW-5217 URL: https://issues.apache.org/jira/browse/AIRFLOW-5217 Project: Apache Airflow Issue Type: Improvement

[jira] [Updated] (AIRFLOW-5217) Fix Pod docstring

2019-08-14 Thread Philippe Gagnon (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philippe Gagnon updated AIRFLOW-5217: - Description: {{Pod}} class docstring is currently out of date with regards to its

[GitHub] [airflow] marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

2019-08-14 Thread GitBox
marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811#issuecomment-521479241 Nevermind, this turned out to be an issue with one of our dynamic DAG plugins

[GitHub] [airflow] marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

2019-08-14 Thread GitBox
marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907716#comment-16907716 ] ASF GitHub Bot commented on AIRFLOW-5207: - marcusianlevine commented on pull request #5811:

[jira] [Closed] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

2019-08-14 Thread Marcus Levine (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine closed AIRFLOW-5207. -- Resolution: Not A Problem This turned out to be an issue with one of our plugins > Mark

[GitHub] [airflow] potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-14 Thread GitBox
potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#issuecomment-521509287 @ashb @dimberman @Fokko -> this is the first additional set of checks (for python

[jira] [Updated] (AIRFLOW-5170) Add static checks for encoding pragma, consistent licences for python files and related pylint fixes

2019-08-14 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5170: -- Description: Automated check for encoding pragma, consisten licence files can be added for

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907620#comment-16907620 ] Kamil Bregula commented on AIRFLOW-: [~pulinpathneja] Any progress? Maybe I can help in

[jira] [Created] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
Darren Weber created AIRFLOW-5218: - Summary: AWS Batch Operator - status polling too often, esp. for high concurrency Key: AIRFLOW-5218 URL: https://issues.apache.org/jira/browse/AIRFLOW-5218

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907762#comment-16907762 ] ASF GitHub Bot commented on AIRFLOW-5218: - darrenleeweber commented on pull request #5825:

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:15 AM: PR at 

[jira] [Assigned] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber reassigned AIRFLOW-5218: - Assignee: Darren Weber > AWS Batch Operator - status polling too often, esp. for high

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber commented on AIRFLOW-5218: --- Even bumping the backoff factor from `0.1` to `0.3` 

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available

[jira] [Created] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

2019-08-14 Thread Derrick Mink (JIRA)
Derrick Mink created AIRFLOW-5221: - Summary: Add host alias support to the KubernetesPodOperator Key: AIRFLOW-5221 URL: https://issues.apache.org/jira/browse/AIRFLOW-5221 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5220) Easy form to create airflow dags

2019-08-14 Thread huangyan (JIRA)
huangyan created AIRFLOW-5220: - Summary: Easy form to create airflow dags Key: AIRFLOW-5220 URL: https://issues.apache.org/jira/browse/AIRFLOW-5220 Project: Apache Airflow Issue Type: New

[GitHub] [airflow] potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files

2019-08-14 Thread GitBox
potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files URL: https://github.com/apache/airflow/pull/5807#discussion_r314178750 ## File path: airflow/example_dags/entrypoint.sh ## @@ -1,20 +1,20 @@ -# -*- coding: utf-8

[GitHub] [airflow] potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

2019-08-14 Thread GitBox
potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#issuecomment-521523483 Made the PR standalone (not depending on series of PRs This is

[GitHub] [airflow] potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

2019-08-14 Thread GitBox
potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#discussion_r314181813 ## File path: airflow/_vendor/slugify/slugify.py ## @@ -1,3 +1,6 @@ +# -*- coding: utf-8 -*-

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907824#comment-16907824 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[jira] [Resolved] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5161. --- Resolution: Fixed Fix Version/s: 1.10.5 > Add pre-commit hooks to run static checks

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available

[GitHub] [airflow] potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files

2019-08-14 Thread GitBox
potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files URL: https://github.com/apache/airflow/pull/5807#issuecomment-521519887 Again - another set of checks. This time for shell files (shellcheck + shebangs/executable + licenses)

[GitHub] [airflow] potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml

2019-08-14 Thread GitBox
potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml URL: https://github.com/apache/airflow/pull/5790#issuecomment-521513998 Part of static checks dealing with yaml (yamllint + consistent licenses). Removed the chaing of depnding

[jira] [Assigned] (AIRFLOW-5176) Add integration with Azure Data Explorer

2019-08-14 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector reassigned AIRFLOW-5176: Assignee: (was: Michael Spector) > Add integration with Azure Data Explorer

[GitHub] [airflow] mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator

2019-08-14 Thread GitBox
mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator URL: https://github.com/apache/airflow/pull/5822 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2019-08-14 Thread GitBox
matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/airflow/pull/4068#issuecomment-521402915 I see the merge failed from what is (hopefully?) a small conflict - can we get eyes on this? can I help?

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907597#comment-16907597 ] ASF GitHub Bot commented on AIRFLOW-4758: - mik-laj commented on pull request #5822:

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907598#comment-16907598 ] Kamil Bregula commented on AIRFLOW-4758: I have created an operator that copies data from GCS

[GitHub] [airflow] ashb commented on a change in pull request #5668: [AIRFLOW-4316] support setting kubernetes_environment_variables config section from env var

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5668: [AIRFLOW-4316] support setting kubernetes_environment_variables config section from env var URL: https://github.com/apache/airflow/pull/5668#discussion_r313769536 ## File path: tests/operators/test_email_operator.py ## @@

[jira] [Commented] (AIRFLOW-5209) Fix Documentation build

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907091#comment-16907091 ] ASF GitHub Bot commented on AIRFLOW-5209: - kaxil commented on pull request #5814:

[jira] [Commented] (AIRFLOW-5209) Fix Documentation build

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907092#comment-16907092 ] ASF subversion and git services commented on AIRFLOW-5209: -- Commit

[jira] [Resolved] (AIRFLOW-5209) Fix Documentation build

2019-08-14 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5209. - Resolution: Fixed > Fix Documentation build > --- > > Key:

[GitHub] [airflow] kaxil merged pull request #5814: [AIRFLOW-5209] Bump Sphinx version to fix doc build

2019-08-14 Thread GitBox
kaxil merged pull request #5814: [AIRFLOW-5209] Bump Sphinx version to fix doc build URL: https://github.com/apache/airflow/pull/5814 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#discussion_r313819287 ## File path: airflow/models/baseoperator.py ## @@ -717,26 +717,27 @@ def

[GitHub] [airflow] mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-08-14 Thread GitBox
mik-laj commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-521171013 @benjamingrenier flake8 is sad ;_; This is an

[jira] [Resolved] (AIRFLOW-4908) Implement BigQuery Hooks/Operators for update_dataset, patch_dataset and get_dataset

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4908. Resolution: Fixed Fix Version/s: 1.10.5 > Implement BigQuery Hooks/Operators for

[jira] [Resolved] (AIRFLOW-5133) Keep original env state in provide_gcp_credential_file

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5133. Resolution: Fixed Fix Version/s: 1.10.5 > Keep original env state in

[jira] [Commented] (AIRFLOW-5133) Keep original env state in provide_gcp_credential_file

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907077#comment-16907077 ] ASF subversion and git services commented on AIRFLOW-5133: -- Commit

[jira] [Commented] (AIRFLOW-5133) Keep original env state in provide_gcp_credential_file

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907076#comment-16907076 ] ASF GitHub Bot commented on AIRFLOW-5133: - mik-laj commented on pull request #5747:

[GitHub] [airflow] mik-laj merged pull request #5747: [AIRFLOW-5133] Keep original env state in provide_gcp_credential_file

2019-08-14 Thread GitBox
mik-laj merged pull request #5747: [AIRFLOW-5133] Keep original env state in provide_gcp_credential_file URL: https://github.com/apache/airflow/pull/5747 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (AIRFLOW-5212) Getting the error "ERROR - Failed to bag_dag"

2019-08-14 Thread Theepan Subramani (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Theepan Subramani updated AIRFLOW-5212: --- Description: The error does not contain any details on why the dag is failing to

[GitHub] [airflow] BasPH commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
BasPH commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#issuecomment-521200790 @danfrankj LGTM, the k8s CI step failed. I believe it's a bit buggy so restarted it.

[GitHub] [airflow] mik-laj commented on issue #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset

2019-08-14 Thread GitBox
mik-laj commented on issue #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset URL: https://github.com/apache/airflow/pull/5566#issuecomment-521171398 Can you do rebase, please? This is an

[GitHub] [airflow] mik-laj merged pull request #5816: [AIRFLOW-5211] Add pass_value to template_fields for BigQueryValueCheckOperator

2019-08-14 Thread GitBox
mik-laj merged pull request #5816: [AIRFLOW-5211] Add pass_value to template_fields for BigQueryValueCheckOperator URL: https://github.com/apache/airflow/pull/5816 This is an automated message from the Apache Git Service.

[jira] [Commented] (AIRFLOW-5211) Add pass_value to template_fields -- BigQueryValueCheckOperator

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907081#comment-16907081 ] ASF GitHub Bot commented on AIRFLOW-5211: - mik-laj commented on pull request #5816:

[jira] [Commented] (AIRFLOW-5211) Add pass_value to template_fields -- BigQueryValueCheckOperator

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907082#comment-16907082 ] ASF subversion and git services commented on AIRFLOW-5211: -- Commit

[GitHub] [airflow] kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#discussion_r313788497 ## File path: airflow/models/baseoperator.py ## @@ -717,26 +717,27 @@ def

[GitHub] [airflow] kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#discussion_r313788497 ## File path: airflow/models/baseoperator.py ## @@ -717,26 +717,27 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators URL: https://github.com/apache/airflow/pull/5672#discussion_r313820298 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -30,72 +34,105 @@

[GitHub] [airflow] potiuk commented on issue #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks

2019-08-14 Thread GitBox
potiuk commented on issue #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks URL: https://github.com/apache/airflow/pull/5777#issuecomment-521238624 Thanks @Fokko -> There are more checks to come, the whole idea is that we can add many more static checks (I have

[jira] [Resolved] (AIRFLOW-5210) Resolving Template Files for large DAGs hurts performance

2019-08-14 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5210. Resolution: Fixed Fix Version/s: 1.10.5 > Resolving Template Files for

[GitHub] [airflow] feluelle commented on a change in pull request #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators

2019-08-14 Thread GitBox
feluelle commented on a change in pull request #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators URL: https://github.com/apache/airflow/pull/5672#discussion_r313879721 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -30,72 +34,105

[GitHub] [airflow] ashb commented on issue #5711: [AIRFLOW-4161] BigQuery to Mysql Operator

2019-08-14 Thread GitBox
ashb commented on issue #5711: [AIRFLOW-4161] BigQuery to Mysql Operator URL: https://github.com/apache/airflow/pull/5711#issuecomment-521260415 Could do that. It's probably an exception that won't ever byte us again anyway.

[jira] [Created] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
venkata Bonu created AIRFLOW-5213: - Summary: DockerOperator failing when the docker default logging drivers are other than 'journald','json-file' Key: AIRFLOW-5213 URL:

[GitHub] [airflow] ashb commented on a change in pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701#discussion_r313867143 ## File path: airflow/dag/serialization.py ## @@ -0,0 +1,250 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701#discussion_r313866659 ## File path: airflow/dag/serialization.py ## @@ -0,0 +1,250 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313870289 ## File path: airflow/api/common/experimental/delete_dag.py ## @@

[jira] [Work started] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5179 started by Ash Berlin-Taylor. -- > Top level __init__.py breaks imports >

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313873973 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,106

[jira] [Commented] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907260#comment-16907260 ] ASF GitHub Bot commented on AIRFLOW-5179: - ashb commented on pull request #5818: [AIRFLOW-5179]

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313873900 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,106

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313873931 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,106

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313873949 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,106

[GitHub] [airflow] ashb opened a new pull request #5818: [AIRFLOW-5179] Remove top level __init__.py

2019-08-14 Thread GitBox
ashb opened a new pull request #5818: [AIRFLOW-5179] Remove top level __init__.py URL: https://github.com/apache/airflow/pull/5818 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] danfrankj commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
danfrankj commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#issuecomment-521260026 You're welcome! Thank you guys. Happy DAG'n This is an

[jira] [Commented] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907291#comment-16907291 ] ASF subversion and git services commented on AIRFLOW-5179: -- Commit

[jira] [Resolved] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5179. Resolution: Fixed > Top level __init__.py breaks imports >

[GitHub] [airflow] potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files depends on AIRFLOW-5161, AIRFLOW-5170, AIRFLOW-5180, AIRFLOW-5204,

2019-08-14 Thread GitBox
potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files depends on AIRFLOW-5161, AIRFLOW-5170, AIRFLOW-5180, AIRFLOW-5204, URL: https://github.com/apache/airflow/pull/5808#issuecomment-521240322 @fokko @feluelle : apologies for that. i split those changes into smaller,

[jira] [Commented] (AIRFLOW-5210) Resolving Template Files for large DAGs hurts performance

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907254#comment-16907254 ] ASF subversion and git services commented on AIRFLOW-5210: -- Commit

  1   2   >