[GitHub] [airflow] zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-03-10 Thread GitBox
zhongjiajie commented on issue #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#issuecomment-597399419 Also and make_success/make_failed to dag.html/tree.html ![](https://i.loli.net/2020/03/11/FLHtAsecoO4ZDlp.png)

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390707943 ## File path: UPDATING.md ## @@ -1047,6 +1048,21 @@ If the DAG

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390707156 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390705298 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390705128 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py

[GitHub] [airflow] swiftomkar commented on issue #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
swiftomkar commented on issue #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#issuecomment-597417616 @zhongjiajie Thanks for your suggestions!

[GitHub] [airflow] swiftomkar commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
swiftomkar commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390719168 ## File path: UPDATING.md ## @@ -1047,6 +1048,21 @@ If the DAG

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#discussion_r390752331 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -340,19 +400,10 @@ def

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7683: [AIRFLOW-7033] Change dag and task state meanwhile

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7683: [AIRFLOW-7033] Change dag and task state meanwhile URL: https://github.com/apache/airflow/pull/7683#discussion_r390752240 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -312,8 +374,6 @@ def

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7685: [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7685: [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op URL: https://github.com/apache/airflow/pull/7685#discussion_r390711422 ## File path: airflow/providers/google/cloud/operators/pubsub.py ## @@

[GitHub] [airflow] potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390753368 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py ##

[GitHub] [airflow] potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390751106 ## File path: UPDATING.md ## @@ -1047,6 +1047,20 @@ If the DAG relies on

[GitHub] [airflow] potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390754114 ## File path: tests/providers/amazon/aws/operators/test_redshift_to_s3.py

[GitHub] [airflow] potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
potiuk commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390753208 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py ##

[GitHub] [airflow] swiftomkar commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
swiftomkar commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390719168 ## File path: UPDATING.md ## @@ -1047,6 +1048,21 @@ If the DAG

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
zhongjiajie commented on a change in pull request #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#discussion_r390752987 ## File path: airflow/providers/amazon/aws/operators/redshift_to_s3.py

[GitHub] [airflow] codecov-io commented on issue #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query

2020-03-10 Thread GitBox
codecov-io commented on issue #7688: [AIRFLOW-6794] Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query URL: https://github.com/apache/airflow/pull/7688#issuecomment-597447171 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7688?src=pr=h1) Report > Merging

[jira] [Resolved] (AIRFLOW-7023) Remove duplicated package definitions in setup.py

2020-03-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-7023. --- Fix Version/s: 1.10.10 Resolution: Fixed > Remove duplicated package definitions in

[jira] [Commented] (AIRFLOW-7023) Remove duplicated package definitions in setup.py

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055728#comment-17055728 ] ASF GitHub Bot commented on AIRFLOW-7023: - potiuk commented on pull request #7675:

[GitHub] [airflow] potiuk commented on issue #7675: [AIRFLOW-7023] Remove duplicated package definitions in setup.py

2020-03-10 Thread GitBox
potiuk commented on issue #7675: [AIRFLOW-7023] Remove duplicated package definitions in setup.py URL: https://github.com/apache/airflow/pull/7675#issuecomment-596982328 Thanks @sekikn ! This is an automated message from the

[GitHub] [airflow] dstandish commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM

2020-03-10 Thread GitBox
dstandish commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM URL: https://github.com/apache/airflow/pull/6376#discussion_r390138022 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -248,6 +248,16 @@

[GitHub] [airflow] potiuk merged pull request #7675: [AIRFLOW-7023] Remove duplicated package definitions in setup.py

2020-03-10 Thread GitBox
potiuk merged pull request #7675: [AIRFLOW-7023] Remove duplicated package definitions in setup.py URL: https://github.com/apache/airflow/pull/7675 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-7023) Remove duplicated package definitions in setup.py

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055737#comment-17055737 ] ASF subversion and git services commented on AIRFLOW-7023: -- Commit

[GitHub] [airflow] dstandish commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM

2020-03-10 Thread GitBox
dstandish commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM URL: https://github.com/apache/airflow/pull/6376#discussion_r389856338 ## File path: airflow/providers/amazon/aws/secrets/ssm.py ## @@ -0,0 +1,120 @@ +# +#

[GitHub] [airflow] nuclearpinguin commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package

2020-03-10 Thread GitBox
nuclearpinguin commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package URL: https://github.com/apache/airflow/pull/7615#issuecomment-596963688 > Can't parse ./airflow/providers/apache/pinot/hooks/pinot.py: ParseError: bad input: type=1, value='exec',

[GitHub] [airflow] zhongjiajie commented on issue #7610: [AIRFLOW-6860] Default ignore_first_depends_on_past to True

2020-03-10 Thread GitBox
zhongjiajie commented on issue #7610: [AIRFLOW-6860] Default ignore_first_depends_on_past to True URL: https://github.com/apache/airflow/pull/7610#issuecomment-596971038 Travis happy, could you please take a look? @ashb @potiuk @nuclearpinguin

[jira] [Commented] (AIRFLOW-7023) Remove duplicated package definitions in setup.py

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055734#comment-17055734 ] ASF subversion and git services commented on AIRFLOW-7023: -- Commit

[jira] [Commented] (AIRFLOW-7023) Remove duplicated package definitions in setup.py

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055732#comment-17055732 ] ASF subversion and git services commented on AIRFLOW-7023: -- Commit

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long

2020-03-10 Thread GitBox
ephraimbuddy commented on a change in pull request #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long URL: https://github.com/apache/airflow/pull/7658#discussion_r390145195 ## File path:

[GitHub] [airflow] zacharya19 commented on a change in pull request #7661: [AIRFLOW-7016] Sort dag tags in the UI

2020-03-10 Thread GitBox
zacharya19 commented on a change in pull request #7661: [AIRFLOW-7016] Sort dag tags in the UI URL: https://github.com/apache/airflow/pull/7661#discussion_r390134634 ## File path: airflow/www/templates/airflow/dags.html ## @@ -105,7 +105,7 @@ DAGs

[GitHub] [airflow] codecov-io edited a comment on issue #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long URL: https://github.com/apache/airflow/pull/7658#issuecomment-596370707 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7658?src=pr=h1) Report >

[GitHub] [airflow] codecov-io edited a comment on issue #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #7658: [AIRFLOW-6443]Increase pool name length to 256, make cli give error if name is too long URL: https://github.com/apache/airflow/pull/7658#issuecomment-596370707 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7658?src=pr=h1) Report >

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390245689 ## File path: airflow/jobs/scheduler_job.py ## @@ -747,21 +747,16 @@ def

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390247701 ## File path: airflow/jobs/scheduler_job.py ## @@ -905,6 +898,28 @@ def

[jira] [Commented] (AIRFLOW-7015) Detect Dockerhub repo/user when building on Dockerhub

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055850#comment-17055850 ] ASF subversion and git services commented on AIRFLOW-7015: -- Commit

[GitHub] [airflow] potiuk merged pull request #7673: [AIRFLOW-7015] Detect Dockerhub repo/user when building on Dockerhub

2020-03-10 Thread GitBox
potiuk merged pull request #7673: [AIRFLOW-7015] Detect Dockerhub repo/user when building on Dockerhub URL: https://github.com/apache/airflow/pull/7673 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-7015) Detect Dockerhub repo/user when building on Dockerhub

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055849#comment-17055849 ] ASF GitHub Bot commented on AIRFLOW-7015: - potiuk commented on pull request #7673:

[GitHub] [airflow] feluelle commented on a change in pull request #7619: [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7619: [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML URL: https://github.com/apache/airflow/pull/7619#discussion_r390251473 ## File path: airflow/providers/amazon/aws/hooks/base_aws.py ## @@ -206,6 +214,106 @@ def

[GitHub] [airflow] blcksrx commented on issue #7422: [AIRFLOW-6809] Test for presto operators

2020-03-10 Thread GitBox
blcksrx commented on issue #7422: [AIRFLOW-6809] Test for presto operators URL: https://github.com/apache/airflow/pull/7422#issuecomment-597047888 > Great! :) LGTM Thanks! This is an automated message from the Apache

[GitHub] [airflow] kaxil commented on issue #7670: [AIRFLOW-XXXX] Small grammar fixes in Best Practices doc

2020-03-10 Thread GitBox
kaxil commented on issue #7670: [AIRFLOW-] Small grammar fixes in Best Practices doc URL: https://github.com/apache/airflow/pull/7670#issuecomment-597053992 Thanks @petedejoy This is an automated message from the Apache

[GitHub] [airflow] kaxil merged pull request #7670: [AIRFLOW-XXXX] Small grammar fixes in Best Practices doc

2020-03-10 Thread GitBox
kaxil merged pull request #7670: [AIRFLOW-] Small grammar fixes in Best Practices doc URL: https://github.com/apache/airflow/pull/7670 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (AIRFLOW-6877) Add backport packages cross-dependency mechanism

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6877: --- Component/s: (was: backport-packages) packages > Add backport

[jira] [Updated] (AIRFLOW-6980) Improve system tests and building providers package

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6980: --- Component/s: (was: tests) (was: backport-packages)

[jira] [Updated] (AIRFLOW-6668) Sometimes kubernetes tests fail in CI

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6668: --- Labels: flaky-test (was: ) > Sometimes kubernetes tests fail in CI >

[jira] [Updated] (AIRFLOW-6668) Sometimes kubernetes tests fail in CI

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6668: --- Component/s: (was: flaky_tests) > Sometimes kubernetes tests fail in CI >

[jira] [Assigned] (AIRFLOW-6914) Add a default robots.txt to deny all search engines

2020-03-10 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-6914: --- Assignee: (was: Kaxil Naik) > Add a default robots.txt to deny all search engines >

[GitHub] [airflow] kaxil commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt

2020-03-10 Thread GitBox
kaxil commented on issue #7653: [AIRFLOW-6914] Add a default robots.txt URL: https://github.com/apache/airflow/pull/7653#issuecomment-597072961 Tests are failing This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check

2020-03-10 Thread GitBox
potiuk commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check URL: https://github.com/apache/airflow/pull/7678#issuecomment-597081727 > Uses https://github.com/ashb/apache-rat-docker (which is set up to auto build). Happy to give other people

[jira] [Commented] (AIRFLOW-7016) Sort dag tags in the UI

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055949#comment-17055949 ] ASF subversion and git services commented on AIRFLOW-7016: -- Commit

[GitHub] [airflow] potiuk commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check

2020-03-10 Thread GitBox
potiuk commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check URL: https://github.com/apache/airflow/pull/7678#issuecomment-597081999 https://hub.docker.com/u/potiuk This is an automated

[GitHub] [airflow] codecov-io commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package

2020-03-10 Thread GitBox
codecov-io commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package URL: https://github.com/apache/airflow/pull/7615#issuecomment-597050665 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7615?src=pr=h1) Report > Merging

[GitHub] [airflow] feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7671#discussion_r390270784 ## File path: tests/providers/docker/operators/test_docker.py ## @@ -81,13 +83,25 @@

[GitHub] [airflow] ashb commented on a change in pull request #7620: [AIRFLOW-6402] Fix SSH Operator Exception

2020-03-10 Thread GitBox
ashb commented on a change in pull request #7620: [AIRFLOW-6402] Fix SSH Operator Exception URL: https://github.com/apache/airflow/pull/7620#discussion_r390272656 ## File path: tests/contrib/operators/test_ssh_operator.py ## @@ -70,6 +70,24 @@ def

[GitHub] [airflow] feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7671#discussion_r390272047 ## File path: tests/providers/docker/operators/test_docker.py ## @@ -81,13 +83,25 @@

[jira] [Commented] (AIRFLOW-6983) Disabled connection pool in CLI might be harmful

2020-03-10 Thread Igor Khrol (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055897#comment-17055897 ] Igor Khrol commented on AIRFLOW-6983: - [~ash], we have 3 workers with 16 worker_concurrency giving

[GitHub] [airflow] ashb opened a new pull request #7678: [AIRFLOW-7029] Use separate docker image for running license check

2020-03-10 Thread GitBox
ashb opened a new pull request #7678: [AIRFLOW-7029] Use separate docker image for running license check URL: https://github.com/apache/airflow/pull/7678 Each stage of the CI tests needs to pull our `ci` image. By removing java from it we can save 1-2minutes from each test stage. This

[GitHub] [airflow] ashb commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check

2020-03-10 Thread GitBox
ashb commented on issue #7678: [AIRFLOW-7029] Use separate docker image for running license check URL: https://github.com/apache/airflow/pull/7678#issuecomment-597067349 Uses https://github.com/ashb/apache-rat-docker (which is set up to auto build). Happy to give other people maintainer

[GitHub] [airflow] codecov-io edited a comment on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package URL: https://github.com/apache/airflow/pull/7615#issuecomment-597050665 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7615?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-7029) Move license check to dedicated image

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055910#comment-17055910 ] ASF GitHub Bot commented on AIRFLOW-7029: - ashb commented on pull request #7678: [AIRFLOW-7029]

[jira] [Commented] (AIRFLOW-6542) sparkKubernetes operator for https://github.com/GoogleCloudPlatform/spark-on-k8s-operator

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055914#comment-17055914 ] ASF subversion and git services commented on AIRFLOW-6542: -- Commit

[jira] [Commented] (AIRFLOW-6542) sparkKubernetes operator for https://github.com/GoogleCloudPlatform/spark-on-k8s-operator

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055913#comment-17055913 ] ASF GitHub Bot commented on AIRFLOW-6542: - kaxil commented on pull request #7163:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-03-10 Thread GitBox
boring-cyborg[bot] commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-597070732 Awesome work, congrats on your first merged pull request!

[GitHub] [airflow] kaxil merged pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-03-10 Thread GitBox
kaxil merged pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-6980) Improve system tests and building providers package

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055931#comment-17055931 ] ASF subversion and git services commented on AIRFLOW-6980: -- Commit

[jira] [Resolved] (AIRFLOW-6443) Pool name - increase length > 50, make cli give error if too large

2020-03-10 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6443. - Fix Version/s: 1.10.10 Resolution: Fixed > Pool name - increase length > 50, make cli

[GitHub] [airflow] kaxil commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM

2020-03-10 Thread GitBox
kaxil commented on a change in pull request #6376: [AIRFLOW-5705] Add secrets backend and support for AWS SSM URL: https://github.com/apache/airflow/pull/6376#discussion_r390310469 ## File path: airflow/providers/amazon/aws/secrets/ssm.py ## @@ -0,0 +1,120 @@ +# +#

[GitHub] [airflow] nuclearpinguin commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package

2020-03-10 Thread GitBox
nuclearpinguin commented on issue #7615: [AIRFLOW-6980] Improve system tests and building providers package URL: https://github.com/apache/airflow/pull/7615#issuecomment-597001164 Ok, I got it. Bowler is refactoring everything each time the package is built (we have a for loop on CI).

[GitHub] [airflow] codecov-io edited a comment on issue #7661: [AIRFLOW-7016] Sort dag tags in the UI

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #7661: [AIRFLOW-7016] Sort dag tags in the UI URL: https://github.com/apache/airflow/pull/7661#issuecomment-596459184 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7661?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6782) airflow-xcom-sidecar container prevents pods from completion

2020-03-10 Thread Maksym Shalak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055831#comment-17055831 ] Maksym Shalak commented on AIRFLOW-6782: [~felipe.gasparini] I just stopped using XCOM. So if I

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390248231 ## File path: airflow/jobs/scheduler_job.py ## @@ -853,6 +853,32 @@ def

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390246266 ## File path: airflow/jobs/scheduler_job.py ## @@ -852,16 +847,16 @@ def

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390246851 ## File path: airflow/jobs/scheduler_job.py ## @@ -905,6 +898,28 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-03-10 Thread GitBox
ashb commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r390255903 ## File path: airflow/providers/cncf/kubernetes/hooks/kubernetes.py ## @@ -0,0 +1,151 @@ +#

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-03-10 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r390260486 ## File path: airflow/providers/cncf/kubernetes/hooks/kubernetes.py ## @@ -0,0 +1,151 @@ +#

[jira] [Commented] (AIRFLOW-6983) Disabled connection pool in CLI might be harmful

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055882#comment-17055882 ] Ash Berlin-Taylor commented on AIRFLOW-6983: "might"? > Disabled connection pool in CLI

[GitHub] [airflow] feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7671#discussion_r390268452 ## File path: airflow/providers/docker/operators/docker.py ## @@ -169,6 +173,7 @@ def

[GitHub] [airflow] feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7671#discussion_r390268570 ## File path: airflow/providers/docker/operators/docker.py ## @@ -218,7 +224,7 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390269625 ## File path: tests/jobs/test_scheduler_job.py ## @@ -842,21 +842,12 @@ def

[jira] [Updated] (AIRFLOW-6922) Support python3.8

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6922: --- Component/s: (was: setup) core > Support python3.8 >

[jira] [Updated] (AIRFLOW-6758) Git repo might be invalid in case you have shared git clone

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6758: --- Component/s: (was: setup) core > Git repo might be invalid in

[jira] [Commented] (AIRFLOW-6429) Add SalesForce connection to UI

2020-03-10 Thread anuradha (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055940#comment-17055940 ] anuradha commented on AIRFLOW-6429: --- hey [~kaxilnaik] , can I start working with this issue as

[jira] [Created] (AIRFLOW-7027) The mirrored data folder for BigQuery_operators can't be accessed on manual runs

2020-03-10 Thread Jonny Evans (Jira)
Jonny Evans created AIRFLOW-7027: Summary: The mirrored data folder for BigQuery_operators can't be accessed on manual runs Key: AIRFLOW-7027 URL: https://issues.apache.org/jira/browse/AIRFLOW-7027

[GitHub] [airflow] ashb commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
ashb commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390260237 ## File path: tests/jobs/test_scheduler_job.py ## @@ -842,21 +842,12 @@ def

[jira] [Commented] (AIRFLOW-7015) Detect Dockerhub repo/user when building on Dockerhub

2020-03-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055874#comment-17055874 ] ASF subversion and git services commented on AIRFLOW-7015: -- Commit

[jira] [Resolved] (AIRFLOW-7015) Detect Dockerhub repo/user when building on Dockerhub

2020-03-10 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-7015. --- Fix Version/s: 1.10.10 Resolution: Fixed > Detect Dockerhub repo/user when building

[jira] [Commented] (AIRFLOW-6402) SSH operator exception - 'NoneType' object has no attribute 'startswith'

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055886#comment-17055886 ] Ash Berlin-Taylor commented on AIRFLOW-6402: The "correct" fix is to make command not be

[jira] [Updated] (AIRFLOW-6756) Airflow resetdb fails in airflow 2.0 if run twice with an error

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6756: --- Component/s: (was: db) database > Airflow resetdb fails in

[jira] [Updated] (AIRFLOW-6974) Using MS SQL Server 17 as a backend, Migration cc1e65623dc7_add_max_tries_column_to_task_instance.py fails if load_examples = True

2020-03-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-6974: --- Component/s: (was: db) database > Using MS SQL Server 17 as a

[GitHub] [airflow] feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-03-10 Thread GitBox
feluelle commented on a change in pull request #7671: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7671#discussion_r390275561 ## File path: airflow/providers/docker/operators/docker.py ## @@ -169,6 +173,7 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390285608 ## File path: airflow/jobs/scheduler_job.py ## @@ -852,16 +847,16 @@ def process_file(

[GitHub] [airflow] mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390267914 ## File path: airflow/jobs/scheduler_job.py ## @@ -747,21 +747,16 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390285717 ## File path: airflow/jobs/scheduler_job.py ## @@ -747,21 +747,16 @@ def

[GitHub] [airflow] blcksrx closed pull request #7544: [AIRFLOW-6922] Support python3.8

2020-03-10 Thread GitBox
blcksrx closed pull request #7544: [AIRFLOW-6922] Support python3.8 URL: https://github.com/apache/airflow/pull/7544 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] blcksrx commented on issue #7544: [AIRFLOW-6922] Support python3.8

2020-03-10 Thread GitBox
blcksrx commented on issue #7544: [AIRFLOW-6922] Support python3.8 URL: https://github.com/apache/airflow/pull/7544#issuecomment-597065709 > Yes we want to support python 3.8 -- but we need to decide what part of the matrix we suppport -- the way this is done right now this will make the

[jira] [Commented] (AIRFLOW-6914) Add a default robots.txt to deny all search engines

2020-03-10 Thread anuradha (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055912#comment-17055912 ] anuradha commented on AIRFLOW-6914: --- hey [~kaxilnaik] can you assign the following issue to me? My

[jira] [Commented] (AIRFLOW-6914) Add a default robots.txt to deny all search engines

2020-03-10 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055923#comment-17055923 ] Kaxil Naik commented on AIRFLOW-6914: - Hi [~anuradha1904], someone has already created a PR. for

[GitHub] [airflow] OmairK opened a new pull request #7679: [AIRFLOW-4438] Add Gzip compression to S3_hook

2020-03-10 Thread GitBox
OmairK opened a new pull request #7679: [AIRFLOW-4438] Add Gzip compression to S3_hook URL: https://github.com/apache/airflow/pull/7679 - Added a gzip parameter to load_file function in aws s3 hook. - Added the gzip parameter to docstring of load_file function -

[jira] [Commented] (AIRFLOW-4438) Add Gzip compression to S3_hook

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055946#comment-17055946 ] ASF GitHub Bot commented on AIRFLOW-4438: - OmairK commented on pull request #7679:

[GitHub] [airflow] mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method

2020-03-10 Thread GitBox
mik-laj commented on a change in pull request #7674: [AIRFLOW-7022] Simplify DagFileProcessor.process_file method URL: https://github.com/apache/airflow/pull/7674#discussion_r390304791 ## File path: tests/jobs/test_scheduler_job.py ## @@ -842,21 +842,12 @@ def

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7679: [AIRFLOW-4438] Add Gzip compression to S3_hook

2020-03-10 Thread GitBox
boring-cyborg[bot] commented on issue #7679: [AIRFLOW-4438] Add Gzip compression to S3_hook URL: https://github.com/apache/airflow/pull/7679#issuecomment-597080100 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure

  1   2   3   >