[GitHub] [airflow] potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

2019-08-14 Thread GitBox
potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#issuecomment-521523483 Made the PR standalone (not depending on series of PRs This is

[GitHub] [airflow] potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

2019-08-14 Thread GitBox
potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#discussion_r314181813 ## File path: airflow/_vendor/slugify/slugify.py ## @@ -1,3 +1,6 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files

2019-08-14 Thread GitBox
potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files URL: https://github.com/apache/airflow/pull/5807#issuecomment-521519887 Again - another set of checks. This time for shell files (shellcheck + shebangs/executable + licenses)

[GitHub] [airflow] potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files

2019-08-14 Thread GitBox
potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files URL: https://github.com/apache/airflow/pull/5807#discussion_r314178750 ## File path: airflow/example_dags/entrypoint.sh ## @@ -1,20 +1,20 @@ -# -*- coding: utf-8

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available

[GitHub] [airflow] potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml

2019-08-14 Thread GitBox
potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml URL: https://github.com/apache/airflow/pull/5790#issuecomment-521513998 Part of static checks dealing with yaml (yamllint + consistent licenses). Removed the chaing of depnding

[jira] [Resolved] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5161. --- Resolution: Fixed Fix Version/s: 1.10.5 > Add pre-commit hooks to run static checks

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907824#comment-16907824 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[GitHub] [airflow] potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-14 Thread GitBox
potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#issuecomment-521509287 @ashb @dimberman @Fokko -> this is the first additional set of checks (for python

[GitHub] [airflow] derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases

2019-08-14 Thread GitBox
derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases URL: https://github.com/apache/airflow/pull/5826 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira] -

[jira] [Created] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

2019-08-14 Thread Derrick Mink (JIRA)
Derrick Mink created AIRFLOW-5221: - Summary: Add host alias support to the KubernetesPodOperator Key: AIRFLOW-5221 URL: https://issues.apache.org/jira/browse/AIRFLOW-5221 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5220) Easy form to create airflow dags

2019-08-14 Thread huangyan (JIRA)
huangyan created AIRFLOW-5220: - Summary: Easy form to create airflow dags Key: AIRFLOW-5220 URL: https://issues.apache.org/jira/browse/AIRFLOW-5220 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-5219) Alarm if the task is not executed within the expected time range.

2019-08-14 Thread huangyan (JIRA)
huangyan created AIRFLOW-5219: - Summary: Alarm if the task is not executed within the expected time range. Key: AIRFLOW-5219 URL: https://issues.apache.org/jira/browse/AIRFLOW-5219 Project: Apache

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907774#comment-16907774 ] Darren Weber commented on AIRFLOW-5218: --- There is something weird in the polling logs.  The

[jira] [Assigned] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber reassigned AIRFLOW-5218: - Assignee: Darren Weber > AWS Batch Operator - status polling too often, esp. for high

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:15 AM: PR at 

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907762#comment-16907762 ] ASF GitHub Bot commented on AIRFLOW-5218: - darrenleeweber commented on pull request #5825:

[GitHub] [airflow] darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-14 Thread GitBox
darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825 ### Jira - [x] My PR addresses the following [Airflow Jira] - https://issues.apache.org/jira/browse/AIRFLOW-5218 ###

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:04 AM: Even

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907749#comment-16907749 ] Darren Weber commented on AIRFLOW-5218: --- Even bumping the backoff factor from `0.1` to `0.3` 

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available

[jira] [Updated] (AIRFLOW-5170) Add static checks for encoding pragma, consistent licences for python files and related pylint fixes

2019-08-14 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5170: -- Description: Automated check for encoding pragma, consisten licence files can be added for

[jira] [Created] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

2019-08-14 Thread Darren Weber (JIRA)
Darren Weber created AIRFLOW-5218: - Summary: AWS Batch Operator - status polling too often, esp. for high concurrency Key: AIRFLOW-5218 URL: https://issues.apache.org/jira/browse/AIRFLOW-5218

[jira] [Closed] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

2019-08-14 Thread Marcus Levine (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine closed AIRFLOW-5207. -- Resolution: Not A Problem This turned out to be an issue with one of our plugins > Mark

[jira] [Commented] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907716#comment-16907716 ] ASF GitHub Bot commented on AIRFLOW-5207: - marcusianlevine commented on pull request #5811:

[GitHub] [airflow] marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

2019-08-14 Thread GitBox
marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811#issuecomment-521479241 Nevermind, this turned out to be an issue with one of our dynamic DAG plugins

[GitHub] [airflow] marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

2019-08-14 Thread GitBox
marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dossett commented on issue #5419: [AIRFLOW-XXXX] Update pydoc of mlengine_operator

2019-08-14 Thread GitBox
dossett commented on issue #5419: [AIRFLOW-] Update pydoc of mlengine_operator URL: https://github.com/apache/airflow/pull/5419#issuecomment-521474769 Thanks @mik-laj, comment updated This is an automated message from

[GitHub] [airflow] potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks

2019-08-14 Thread GitBox
potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks URL: https://github.com/apache/airflow/pull/5777 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907710#comment-16907710 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907709#comment-16907709 ] ASF GitHub Bot commented on AIRFLOW-5161: - potiuk commented on pull request #5777:

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521466853 Test failure seems unrelated. This is an automated message

[jira] [Updated] (AIRFLOW-5217) Fix Pod docstring

2019-08-14 Thread Philippe Gagnon (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philippe Gagnon updated AIRFLOW-5217: - Description: {{Pod}} class docstring is currently out of date with regards to its

[jira] [Created] (AIRFLOW-5217) Fix Pod docstring

2019-08-14 Thread Philippe Gagnon (JIRA)
Philippe Gagnon created AIRFLOW-5217: Summary: Fix Pod docstring Key: AIRFLOW-5217 URL: https://issues.apache.org/jira/browse/AIRFLOW-5217 Project: Apache Airflow Issue Type: Improvement

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521460427 @ashb @dimberman This is an automated message from the

[jira] [Commented] (AIRFLOW-5215) Add sidecar container support to Pod object

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907695#comment-16907695 ] ASF GitHub Bot commented on AIRFLOW-5215: - pgagnon commented on pull request #5824:

[GitHub] [airflow] pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-14 Thread GitBox
pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page

2019-08-14 Thread GitBox
mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page URL: https://github.com/apache/airflow/pull/5823 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314102570 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section

2019-08-14 Thread GitBox
mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section URL: https://github.com/apache/airflow/pull/5776 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907620#comment-16907620 ] Kamil Bregula commented on AIRFLOW-: [~pulinpathneja] Any progress? Maybe I can help in

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907598#comment-16907598 ] Kamil Bregula commented on AIRFLOW-4758: I have created an operator that copies data from GCS

[jira] [Assigned] (AIRFLOW-5176) Add integration with Azure Data Explorer

2019-08-14 Thread Michael Spector (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector reassigned AIRFLOW-5176: Assignee: (was: Michael Spector) > Add integration with Azure Data Explorer

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907597#comment-16907597 ] ASF GitHub Bot commented on AIRFLOW-4758: - mik-laj commented on pull request #5822:

[GitHub] [airflow] matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2019-08-14 Thread GitBox
matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/airflow/pull/4068#issuecomment-521402915 I see the merge failed from what is (hopefully?) a small conflict - can we get eyes on this? can I help?

[GitHub] [airflow] mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator

2019-08-14 Thread GitBox
mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator URL: https://github.com/apache/airflow/pull/5822 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314046484 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-520101071 Pending Issues: - ~Add Timezone support to `serialized_dag` table~ - ~We still have the

[GitHub] [airflow] JCoder01 commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators

2019-08-14 Thread GitBox
JCoder01 commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators URL: https://github.com/apache/airflow/pull/5672#issuecomment-521384333 I'm actually not using IMAP anymore after the powers that be made me switch to office 365 and disabled

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314042957 ## File path: airflow/models/dag.py ## @@ -1509,8 +1518,19 @@ def

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314041450 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314040957 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314041221 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 @zhongjiajie > > Pending Issues: > > > > * We still have the issue of

[jira] [Updated] (AIRFLOW-5216) Add Azure File Share Sensor

2019-08-14 Thread Albert Yau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Yau updated AIRFLOW-5216: Description: Add sensor to check if a file exists on Azure File Share. (was: Add sensor to

[jira] [Updated] (AIRFLOW-5216) Add Azure File Share Sensor

2019-08-14 Thread Albert Yau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Yau updated AIRFLOW-5216: Description: Add sensor to check if a file exists on Azure File Share using the existing

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907535#comment-16907535 ] ASF GitHub Bot commented on AIRFLOW-5118: - idralyuk commented on pull request #5821:

[GitHub] [airflow] idralyuk opened a new pull request #5821: [AIRFLOW-5118] Add ability to specify optional components in Dataproc…

2019-08-14 Thread GitBox
idralyuk opened a new pull request #5821: [AIRFLOW-5118] Add ability to specify optional components in Dataproc… URL: https://github.com/apache/airflow/pull/5821 …ClusterCreateOperator ### Jira https://issues.apache.org/jira/browse/AIRFLOW-5118 ### Description

[jira] [Created] (AIRFLOW-5216) Add Azure File Share Sensor

2019-08-14 Thread Albert Yau (JIRA)
Albert Yau created AIRFLOW-5216: --- Summary: Add Azure File Share Sensor Key: AIRFLOW-5216 URL: https://issues.apache.org/jira/browse/AIRFLOW-5216 Project: Apache Airflow Issue Type: New Feature

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907528#comment-16907528 ] ASF GitHub Bot commented on AIRFLOW-5118: - idralyuk commented on pull request #5820:

[GitHub] [airflow] idralyuk closed pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc…

2019-08-14 Thread GitBox
idralyuk closed pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc… URL: https://github.com/apache/airflow/pull/5820 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] feluelle commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators

2019-08-14 Thread GitBox
feluelle commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators URL: https://github.com/apache/airflow/pull/5672#issuecomment-521363251 @JCoder01 @kurtqq aren't you using the IMAP thingy?  ..and want to have a final look at it? :)

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907520#comment-16907520 ] ASF GitHub Bot commented on AIRFLOW-5118: - idralyuk commented on pull request #5820:

[GitHub] [airflow] idralyuk opened a new pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc…

2019-08-14 Thread GitBox
idralyuk opened a new pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc… URL: https://github.com/apache/airflow/pull/5820 …ClusterCreateOperator ### Jira https://issues.apache.org/jira/browse/AIRFLOW-5118 ### Description

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 @zhongjiajie > > Pending Issues: > > > > * We still have the issue of

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 @zhongjiajie > > Pending Issues: > > > > * We still have the issue of

[GitHub] [airflow] kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 > > Pending Issues: > > > > * We still have the issue of `SerializedBaseOperator` being displayed

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 @zhongjiajie > > Pending Issues: > > > > * We still have the issue of

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907510#comment-16907510 ] ASF GitHub Bot commented on AIRFLOW-5118: - idralyuk commented on pull request #5820:

[GitHub] [airflow] rasmi commented on issue #5720: [AIRFLOW-5099][WIP-DONT-MERGE] Implement Google Cloud AutoML operators

2019-08-14 Thread GitBox
rasmi commented on issue #5720: [AIRFLOW-5099][WIP-DONT-MERGE] Implement Google Cloud AutoML operators URL: https://github.com/apache/airflow/pull/5720#issuecomment-521356636 No review comments here, I'm just excited for this to be merged -- thank you all for your work!

[GitHub] [airflow] idralyuk closed pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc…

2019-08-14 Thread GitBox
idralyuk closed pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc… URL: https://github.com/apache/airflow/pull/5820 This is an automated message from the Apache Git Service. To

[jira] [Created] (AIRFLOW-5215) Add sidecar container support to Pod object

2019-08-14 Thread Philippe Gagnon (JIRA)
Philippe Gagnon created AIRFLOW-5215: Summary: Add sidecar container support to Pod object Key: AIRFLOW-5215 URL: https://issues.apache.org/jira/browse/AIRFLOW-5215 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907469#comment-16907469 ] ASF GitHub Bot commented on AIRFLOW-5118: - idralyuk commented on pull request #5820:

[GitHub] [airflow] idralyuk opened a new pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc…

2019-08-14 Thread GitBox
idralyuk opened a new pull request #5820: [AIRFLOW-5118] Add ability to specify optional components in Dataproc… URL: https://github.com/apache/airflow/pull/5820 …ClusterCreateOperator ### Jira https://issues.apache.org/jira/browse/AIRFLOW-5118 ### Description

[jira] [Closed] (AIRFLOW-5183) Preprare documentation for new GCP import paths

2019-08-14 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5183. -- Resolution: Fixed Fix Version/s: 2.0.0 > Preprare documentation for new GCP import

[jira] [Commented] (AIRFLOW-5183) Preprare documentation for new GCP import paths

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907456#comment-16907456 ] ASF subversion and git services commented on AIRFLOW-5183: -- Commit

[jira] [Commented] (AIRFLOW-5183) Preprare documentation for new GCP import paths

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907455#comment-16907455 ] ASF GitHub Bot commented on AIRFLOW-5183: - mik-laj commented on pull request #5791:

[GitHub] [airflow] mik-laj merged pull request #5791: [AIRFLOW-5183] Preprare documentation for new GCP import paths

2019-08-14 Thread GitBox
mik-laj merged pull request #5791: [AIRFLOW-5183] Preprare documentation for new GCP import paths URL: https://github.com/apache/airflow/pull/5791 This is an automated message from the Apache Git Service. To respond to the

[jira] [Assigned] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-08-14 Thread Igor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor reassigned AIRFLOW-5118: - Assignee: Igor (was: Kaxil Naik) > Airflow DataprocClusterCreateOperator does not currently support

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313965300 ## File path: airflow/api/common/experimental/delete_dag.py ## @@

[jira] [Commented] (AIRFLOW-5147) Annotations for k8s executors should support extended alphabet (like '/'))

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907384#comment-16907384 ] ASF GitHub Bot commented on AIRFLOW-5147: - andrei-l commented on pull request #5819:

[GitHub] [airflow] andrei-l opened a new pull request #5819: [AIRFLOW-5147] extended character set for for k8s worker pods annotations

2019-08-14 Thread GitBox
andrei-l opened a new pull request #5819: [AIRFLOW-5147] extended character set for for k8s worker pods annotations URL: https://github.com/apache/airflow/pull/5819 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] danfrankj commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-14 Thread GitBox
danfrankj commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#issuecomment-521300533 @BasPH was something wrong with this PR? - I'm seeing a message above about a revert

[jira] [Assigned] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu reassigned AIRFLOW-5213: - Assignee: venkata Bonu > DockerOperator failing when the docker default logging

[jira] [Assigned] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu reassigned AIRFLOW-5213: - Assignee: (was: venkata Bonu) > DockerOperator failing when the docker default

[jira] [Commented] (AIRFLOW-5210) Resolving Template Files for large DAGs hurts performance

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907336#comment-16907336 ] ASF subversion and git services commented on AIRFLOW-5210: -- Commit

[jira] [Resolved] (AIRFLOW-5211) Add pass_value to template_fields -- BigQueryValueCheckOperator

2019-08-14 Thread Damon Liao (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damon Liao resolved AIRFLOW-5211. - Resolution: Fixed > Add pass_value to template_fields -- BigQueryValueCheckOperator >

[jira] [Commented] (AIRFLOW-5182) "KubernetesOperator" isn't implemented

2019-08-14 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907329#comment-16907329 ] Ash Berlin-Taylor commented on AIRFLOW-5182: There never has been a KubernetesOperator, and

[jira] [Created] (AIRFLOW-5214) Airflow leaves too many TIME_WAIT TCP connections

2019-08-14 Thread Oliver Ricken (JIRA)
Oliver Ricken created AIRFLOW-5214: -- Summary: Airflow leaves too many TIME_WAIT TCP connections Key: AIRFLOW-5214 URL: https://issues.apache.org/jira/browse/AIRFLOW-5214 Project: Apache Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-14 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r313909969 ## File path: airflow/dag/serialization/serialized_baseoperator.py ##

[jira] [Updated] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu updated AIRFLOW-5213: -- Attachment: (was: Screen Shot 2019-08-14 at 7.08.44 AM.png) > DockerOperator failing

[jira] [Updated] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu updated AIRFLOW-5213: -- Attachment: (was: Screen Shot 2019-08-14 at 7.10.01 AM.png) > DockerOperator failing

[jira] [Updated] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu updated AIRFLOW-5213: -- Attachment: Screen Shot 2019-08-14 at 7.08.44 AM.png > DockerOperator failing when the

[jira] [Updated] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu updated AIRFLOW-5213: -- Attachment: Screen Shot 2019-08-14 at 7.09.27 AM.png > DockerOperator failing when the

[jira] [Updated] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata Bonu updated AIRFLOW-5213: -- Attachment: (was: Screen Shot 2019-08-14 at 7.09.27 AM.png) > DockerOperator failing

[GitHub] [airflow] potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files depends on AIRFLOW-5161, AIRFLOW-5170, AIRFLOW-5180, AIRFLOW-5204,

2019-08-14 Thread GitBox
potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files depends on AIRFLOW-5161, AIRFLOW-5170, AIRFLOW-5180, AIRFLOW-5204, URL: https://github.com/apache/airflow/pull/5808#discussion_r313897477 ## File path: airflow/_vendor/slugify/slugify.py

[jira] [Created] (AIRFLOW-5213) DockerOperator failing when the docker default logging drivers are other than 'journald','json-file'

2019-08-14 Thread venkata Bonu (JIRA)
venkata Bonu created AIRFLOW-5213: - Summary: DockerOperator failing when the docker default logging drivers are other than 'journald','json-file' Key: AIRFLOW-5213 URL:

[jira] [Commented] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907291#comment-16907291 ] ASF subversion and git services commented on AIRFLOW-5179: -- Commit

[jira] [Resolved] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5179. Resolution: Fixed > Top level __init__.py breaks imports >

[jira] [Commented] (AIRFLOW-5179) Top level __init__.py breaks imports

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907290#comment-16907290 ] ASF GitHub Bot commented on AIRFLOW-5179: - ashb commented on pull request #5818: [AIRFLOW-5179]

  1   2   >