[jira] [Updated] (AIRFLOW-5216) Add Azure File Share Sensor

[ https://issues.apache.org/jira/browse/AIRFLOW-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Yau updated AIRFLOW-5216: Description: Add sensor to check if a file exists on Azure File Share using the existing AzureFil

[jira] [Updated] (AIRFLOW-5216) Add Azure File Share Sensor

[ https://issues.apache.org/jira/browse/AIRFLOW-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Yau updated AIRFLOW-5216: Description: Add sensor to check if a file exists on Azure File Share. (was: Add sensor to c**he

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521358954 @zhongjiajie > > Pending Issues: > > > > * We still have the issue of `SerializedBaseOpe

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314040957 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@ +#

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314041221 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@ +#

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314041450 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@ +#

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314042957 ## File path: airflow/models/dag.py ## @@ -1509,8 +1518,19 @@ def get_

[GitHub] [airflow] JCoder01 commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators

JCoder01 commented on issue #5672: [AIRFLOW-5056] Add argument to filter mails in ImapHook and related operators URL: https://github.com/apache/airflow/pull/5672#issuecomment-521384333 I'm actually not using IMAP anymore after the powers that be made me switch to office 365 and disabled IM

[GitHub] [airflow] kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-520101071 Pending Issues: - ~Add Timezone support to `serialized_dag` table~ - ~We still have the i

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314046484 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@ +#

[GitHub] [airflow] mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator

mik-laj opened a new pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator URL: https://github.com/apache/airflow/pull/5822 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRF

[GitHub] [airflow] matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

matwerber1 commented on issue #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/airflow/pull/4068#issuecomment-521402915 I see the merge failed from what is (hopefully?) a small conflict - can we get eyes on this? can I help?

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907597#comment-16907597 ] ASF GitHub Bot commented on AIRFLOW-4758: - mik-laj commented on pull request #5

[jira] [Assigned] (AIRFLOW-5176) Add integration with Azure Data Explorer

[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Spector reassigned AIRFLOW-5176: Assignee: (was: Michael Spector) > Add integration with Azure Data Explorer

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907598#comment-16907598 ] Kamil Bregula commented on AIRFLOW-4758: I have created an operator that copies

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907620#comment-16907620 ] Kamil Bregula commented on AIRFLOW-: [~pulinpathneja] Any progress? Maybe I

[GitHub] [airflow] mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section

mik-laj merged pull request #5776: [AIRFLOW-XXX] Group references in one section URL: https://github.com/apache/airflow/pull/5776 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314102570 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,155 @@ +#

[GitHub] [airflow] mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page

mik-laj opened a new pull request #5823: [AIRFLOW-XXX] Create "Using the CLI" page URL: https://github.com/apache/airflow/pull/5823 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/

[GitHub] [airflow] pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

pgagnon opened a new pull request #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira](https://issues.apache

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521460427 @ashb @dimberman This is an automated message from the Apac

[jira] [Commented] (AIRFLOW-5215) Add sidecar container support to Pod object

[ https://issues.apache.org/jira/browse/AIRFLOW-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907695#comment-16907695 ] ASF GitHub Bot commented on AIRFLOW-5215: - pgagnon commented on pull request #5

[jira] [Created] (AIRFLOW-5217) Fix Pod docstring

Philippe Gagnon created AIRFLOW-5217: Summary: Fix Pod docstring Key: AIRFLOW-5217 URL: https://issues.apache.org/jira/browse/AIRFLOW-5217 Project: Apache Airflow Issue Type: Improvement

[jira] [Updated] (AIRFLOW-5217) Fix Pod docstring

[ https://issues.apache.org/jira/browse/AIRFLOW-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philippe Gagnon updated AIRFLOW-5217: - Description: {{Pod}} class docstring is currently out of date with regards to its {{__i

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521466853 Test failure seems unrelated. This is an automated message f

[GitHub] [airflow] potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks

potiuk merged pull request #5777: [AIRFLOW-5161] Static checks are run automatically in pre-commit hooks URL: https://github.com/apache/airflow/pull/5777 This is an automated message from the Apache Git Service. To respond t

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907710#comment-16907710 ] ASF subversion and git services commented on AIRFLOW-5161: -- Co

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907709#comment-16907709 ] ASF GitHub Bot commented on AIRFLOW-5161: - potiuk commented on pull request #57

[GitHub] [airflow] dossett commented on issue #5419: [AIRFLOW-XXXX] Update pydoc of mlengine_operator

dossett commented on issue #5419: [AIRFLOW-] Update pydoc of mlengine_operator URL: https://github.com/apache/airflow/pull/5419#issuecomment-521474769 Thanks @mik-laj, comment updated This is an automated message from the

[GitHub] [airflow] marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

marcusianlevine commented on issue #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811#issuecomment-521479241 Nevermind, this turned out to be an issue with one of our dynamic DAG plugins

[GitHub] [airflow] marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views

marcusianlevine closed pull request #5811: [AIRFLOW-5207] Fix Mark Success and Failure views URL: https://github.com/apache/airflow/pull/5811 This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Commented] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907716#comment-16907716 ] ASF GitHub Bot commented on AIRFLOW-5207: - marcusianlevine commented on pull re

[jira] [Closed] (AIRFLOW-5207) Mark Success and Mark Failed views error out due to DAG reassignment

[ https://issues.apache.org/jira/browse/AIRFLOW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine closed AIRFLOW-5207. -- Resolution: Not A Problem This turned out to be an issue with one of our plugins > Mark Succ

[jira] [Created] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

Darren Weber created AIRFLOW-5218: - Summary: AWS Batch Operator - status polling too often, esp. for high concurrency Key: AIRFLOW-5218 URL: https://issues.apache.org/jira/browse/AIRFLOW-5218 Project:

[jira] [Updated] (AIRFLOW-5170) Add static checks for encoding pragma, consistent licences for python files and related pylint fixes

[ https://issues.apache.org/jira/browse/AIRFLOW-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5170: -- Description: Automated check for encoding pragma, consisten licence files can be added for p

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907749#comment-16907749 ] Darren Weber commented on AIRFLOW-5218: --- Even bumping the backoff factor from `0.

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available an

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:04 AM: -

[GitHub] [airflow] darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

darrenleeweber opened a new pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825 ### Jira - [x] My PR addresses the following [Airflow Jira] - https://issues.apache.org/jira/browse/AIRFLOW-5218 ### Description

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907762#comment-16907762 ] ASF GitHub Bot commented on AIRFLOW-5218: - darrenleeweber commented on pull req

[jira] [Comment Edited] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907749#comment-16907749 ] Darren Weber edited comment on AIRFLOW-5218 at 8/15/19 2:15 AM: -

[jira] [Assigned] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber reassigned AIRFLOW-5218: - Assignee: Darren Weber > AWS Batch Operator - status polling too often, esp. for high

[jira] [Commented] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907774#comment-16907774 ] Darren Weber commented on AIRFLOW-5218: --- There is something weird in the polling

[jira] [Created] (AIRFLOW-5219) Alarm if the task is not executed within the expected time range.

huangyan created AIRFLOW-5219: - Summary: Alarm if the task is not executed within the expected time range. Key: AIRFLOW-5219 URL: https://issues.apache.org/jira/browse/AIRFLOW-5219 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5220) Easy form to create airflow dags

huangyan created AIRFLOW-5220: - Summary: Easy form to create airflow dags Key: AIRFLOW-5220 URL: https://issues.apache.org/jira/browse/AIRFLOW-5220 Project: Apache Airflow Issue Type: New Feature

[jira] [Created] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

Derrick Mink created AIRFLOW-5221: - Summary: Add host alias support to the KubernetesPodOperator Key: AIRFLOW-5221 URL: https://issues.apache.org/jira/browse/AIRFLOW-5221 Project: Apache Airflow

[GitHub] [airflow] derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases

derrick-mink-sp opened a new pull request #5826: Sailpoint internal/pod aliases URL: https://github.com/apache/airflow/pull/5826 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira] - https://issues.apache.org/jira/brows

[GitHub] [airflow] potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

potiuk commented on issue #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#issuecomment-521509287 @ashb @dimberman @Fokko -> this is the first additional set of checks (for python fi

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907824#comment-16907824 ] ASF subversion and git services commented on AIRFLOW-5161: -- Co

[jira] [Resolved] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5161. --- Resolution: Fixed Fix Version/s: 1.10.5 > Add pre-commit hooks to run static checks

[GitHub] [airflow] potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml

potiuk commented on issue #5790: [AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml URL: https://github.com/apache/airflow/pull/5790#issuecomment-521513998 Part of static checks dealing with yaml (yamllint + consistent licenses). Removed the chaing of depnding commits.

[jira] [Updated] (AIRFLOW-5218) AWS Batch Operator - status polling too often, esp. for high concurrency

[ https://issues.apache.org/jira/browse/AIRFLOW-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darren Weber updated AIRFLOW-5218: -- Description: The AWS Batch Operator attempts to use a boto3 feature that is not available an

[GitHub] [airflow] potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files

potiuk commented on a change in pull request #5807: [AIRFLOW-5204] Shellcheck + common licence in shell files URL: https://github.com/apache/airflow/pull/5807#discussion_r314178750 ## File path: airflow/example_dags/entrypoint.sh ## @@ -1,20 +1,20 @@ -# -*- coding: utf-8

[GitHub] [airflow] potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files

potiuk commented on issue #5807: [AIRFLOW-5204] Shellcheck + common licences in shell files URL: https://github.com/apache/airflow/pull/5807#issuecomment-521519887 Again - another set of checks. This time for shell files (shellcheck + shebangs/executable + licenses) -

[GitHub] [airflow] potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

potiuk commented on a change in pull request #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#discussion_r314181813 ## File path: airflow/_vendor/slugify/slugify.py ## @@ -1,3 +1,6 @@ +# -*- coding: utf-8 -*- +

[GitHub] [airflow] potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses

potiuk commented on issue #5808: [AIRFLOW-5205] Check xml files with xmllint + Licenses URL: https://github.com/apache/airflow/pull/5808#issuecomment-521523483 Made the PR standalone (not depending on series of PRs This is a

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907850#comment-16907850 ] ASF subversion and git services commented on AIRFLOW-5161: -- Co

<    1   2