[jira] [Commented] (AIRFLOW-2761) Parallelize Celery Executor enqueuing

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617096#comment-16617096 ] ASF GitHub Bot commented on AIRFLOW-2761: - yrqls21 closed pull request #3910:

[GitHub] yrqls21 closed pull request #3910: [WIP][AIRFLOW-2761] Parallelize enqueue in celery executor

2018-09-16 Thread GitBox
yrqls21 closed pull request #3910: [WIP][AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/3910 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2761) Parallelize Celery Executor enqueuing

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617087#comment-16617087 ] ASF GitHub Bot commented on AIRFLOW-2761: - yrqls21 opened a new pull request #3910:

[GitHub] yrqls21 opened a new pull request #3910: [WIP][AIRFLOW-2761] Parallelize enqueue in celery executor

2018-09-16 Thread GitBox
yrqls21 opened a new pull request #3910: [WIP][AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/3910 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-3074) Missing options in ECS operator

2018-09-16 Thread Josh Carp (JIRA)
Josh Carp created AIRFLOW-3074: -- Summary: Missing options in ECS operator Key: AIRFLOW-3074 URL: https://issues.apache.org/jira/browse/AIRFLOW-3074 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-3073) A note is needed in 'Data Profiling' doc page to reminder users it's no longer supported in new webserver UI

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616988#comment-16616988 ] ASF GitHub Bot commented on AIRFLOW-3073: - XD-DENG opened a new pull request #3909:

[GitHub] XD-DENG opened a new pull request #3909: [AIRFLOW-3073] Add note-Profiling feature not supported in new webserver

2018-09-16 Thread GitBox
XD-DENG opened a new pull request #3909: [AIRFLOW-3073] Add note-Profiling feature not supported in new webserver URL: https://github.com/apache/incubator-airflow/pull/3909 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-3073) A note is needed in 'Data Profiling' doc page to reminder users it's no longer supported in new webserver UI

2018-09-16 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-3073: --- Description: In [https://airflow.incubator.apache.org/profiling.html,] it's not mentioned

[jira] [Created] (AIRFLOW-3073) A note is needed in 'Data Profiling' doc page to reminder users it's no longer supported in new webserver UI

2018-09-16 Thread Xiaodong DENG (JIRA)
Xiaodong DENG created AIRFLOW-3073: -- Summary: A note is needed in 'Data Profiling' doc page to reminder users it's no longer supported in new webserver UI Key: AIRFLOW-3073 URL:

[GitHub] jmcarp opened a new pull request #3908: [WIP] Add relevant ECS options to ECS operator.

2018-09-16 Thread GitBox
jmcarp opened a new pull request #3908: [WIP] Add relevant ECS options to ECS operator. URL: https://github.com/apache/incubator-airflow/pull/3908 The ECS operator currently supports only a subset of available options for running ECS tasks. This patch adds all ECS options that could be

[jira] [Updated] (AIRFLOW-1195) Cleared tasks in SubDagOperator do not trigger Parent dag_runs

2018-09-16 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-1195: Summary: Cleared tasks in SubDagOperator do not trigger Parent dag_runs (was: Cleared tasks in

[jira] [Assigned] (AIRFLOW-1195) Cleared tasks in SubDagOperator do not trigger upstream dag_runs

2018-09-16 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-1195: --- Assignee: Kaxil Naik > Cleared tasks in SubDagOperator do not trigger upstream dag_runs >

[GitHub] feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

2018-09-16 Thread GitBox
feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-421856616 I will try to spend some time on the pr tomorrow. This is

[GitHub] kaxil opened a new pull request #3907: WIP: [AIRFLOW-1195] Add feature to clear tasks in Parent Dag

2018-09-16 Thread GitBox
kaxil opened a new pull request #3907: WIP: [AIRFLOW-1195] Add feature to clear tasks in Parent Dag URL: https://github.com/apache/incubator-airflow/pull/3907 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-1195) Cleared tasks in SubDagOperator do not trigger upstream dag_runs

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616902#comment-16616902 ] ASF GitHub Bot commented on AIRFLOW-1195: - kaxil opened a new pull request #3907: WIP:

[jira] [Created] (AIRFLOW-3072) Only admin can view logs in RBAC UI

2018-09-16 Thread Stefan Seelmann (JIRA)
Stefan Seelmann created AIRFLOW-3072: Summary: Only admin can view logs in RBAC UI Key: AIRFLOW-3072 URL: https://issues.apache.org/jira/browse/AIRFLOW-3072 Project: Apache Airflow Issue

[GitHub] seelmann opened a new pull request #1: Improve Docker image for local development

2018-09-16 Thread GitBox
seelmann opened a new pull request #1: Improve Docker image for local development URL: https://github.com/apache/incubator-airflow-ci/pull/1 * Expose port 8080 to host for accessing webserver * Install nodejs to be able to build `www_rbac` assets * Install virtualenv to be able to

[jira] [Work started] (AIRFLOW-2747) Explicit re-schedule of sensors

2018-09-16 Thread Stefan Seelmann (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2747 started by Stefan Seelmann. > Explicit re-schedule of sensors > --- >

[GitHub] seelmann edited a comment on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

2018-09-16 Thread GitBox
seelmann edited a comment on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-421815236 @Fokko I rebased again and made following changes: * Instead of using a `reschedule` boolean flag I switched to

[GitHub] seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

2018-09-16 Thread GitBox
seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-421815236 @Fokko I rebased again and made following chages: * Instead of using a `reschedule` boolean flag I switched to `mode`

[jira] [Updated] (AIRFLOW-2747) Explicit re-schedule of sensors

2018-09-16 Thread Stefan Seelmann (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Seelmann updated AIRFLOW-2747: - Attachment: Screenshot_2018-09-16_20-09-28.png > Explicit re-schedule of sensors >

[jira] [Commented] (AIRFLOW-2747) Explicit re-schedule of sensors

2018-09-16 Thread Stefan Seelmann (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616842#comment-16616842 ] Stefan Seelmann commented on AIRFLOW-2747: -- I changed the Gantt view to not show each

[jira] [Updated] (AIRFLOW-2747) Explicit re-schedule of sensors

2018-09-16 Thread Stefan Seelmann (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Seelmann updated AIRFLOW-2747: - Attachment: Screenshot_2018-09-16_20-19-23.png > Explicit re-schedule of sensors >

[GitHub] r39132 commented on issue #1910: [AIRFLOW-659] Automatic Refresh on DAG Graph View

2018-09-16 Thread GitBox
r39132 commented on issue #1910: [AIRFLOW-659] Automatic Refresh on DAG Graph View URL: https://github.com/apache/incubator-airflow/pull/1910#issuecomment-421794784 @robin-miller-ow A few questions: 1. Would you be interested in making this work on all views, instead of just on the

[GitHub] r39132 commented on issue #1869: [AIRFLOW-571] added --forwarded_allow_ips as a command line argument to webserver

2018-09-16 Thread GitBox
r39132 commented on issue #1869: [AIRFLOW-571] added --forwarded_allow_ips as a command line argument to webserver URL: https://github.com/apache/incubator-airflow/pull/1869#issuecomment-421793313 Hi @dennisobrien How would you like to proceed with this PR? Would you like to take

[GitHub] r39132 commented on issue #1601: [AIRFLOW-249] Refactor the SLA mechanism

2018-09-16 Thread GitBox
r39132 commented on issue #1601: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/1601#issuecomment-421792600 Hi @dud225 I wanted to see if you were still interested in taking a crack at this. If I don't hear back in a few days, I'll close

[jira] [Closed] (AIRFLOW-3068) Remove deprecated import mechanism

2018-09-16 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-3068. Resolution: Fixed > Remove deprecated import mechanism >

[jira] [Commented] (AIRFLOW-3068) Remove deprecated import mechanism

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616781#comment-16616781 ] ASF GitHub Bot commented on AIRFLOW-3068: - r39132 closed pull request #3906: [AIRFLOW-3068]

[GitHub] r39132 closed pull request #3906: [AIRFLOW-3068] Remove deprecated imports

2018-09-16 Thread GitBox
r39132 closed pull request #3906: [AIRFLOW-3068] Remove deprecated imports URL: https://github.com/apache/incubator-airflow/pull/3906 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] r39132 commented on issue #3906: [AIRFLOW-3068] Remove deprecated imports

2018-09-16 Thread GitBox
r39132 commented on issue #3906: [AIRFLOW-3068] Remove deprecated imports URL: https://github.com/apache/incubator-airflow/pull/3906#issuecomment-421789103 +1 This is an automated message from the Apache Git Service. To

[GitHub] XD-DENG commented on issue #3863: [AIRFLOW-3070] Refine web UI authentication-related docs

2018-09-16 Thread GitBox
XD-DENG commented on issue #3863: [AIRFLOW-3070] Refine web UI authentication-related docs URL: https://github.com/apache/incubator-airflow/pull/3863#issuecomment-421768717 Thanks @kaxil . Appreciate the time you guys contributed as well. Especially now, a Sunday :) A nice

[jira] [Commented] (AIRFLOW-3070) Refine web UI authentication-related docs

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616705#comment-16616705 ] ASF GitHub Bot commented on AIRFLOW-3070: - kaxil closed pull request #3863: [AIRFLOW-3070]

[jira] [Resolved] (AIRFLOW-3070) Refine web UI authentication-related docs

2018-09-16 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3070. - Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/3863 > Refine

[GitHub] kaxil commented on issue #3863: [AIRFLOW-3070] Refine web UI authentication-related docs

2018-09-16 Thread GitBox
kaxil commented on issue #3863: [AIRFLOW-3070] Refine web UI authentication-related docs URL: https://github.com/apache/incubator-airflow/pull/3863#issuecomment-421758473 @XD-DENG Hey, No worries :-) . The idea behind there is no point in creating a Jira where we are just fixing typos or

[GitHub] kaxil closed pull request #3863: [AIRFLOW-3070] Refine web UI authentication-related docs

2018-09-16 Thread GitBox
kaxil closed pull request #3863: [AIRFLOW-3070] Refine web UI authentication-related docs URL: https://github.com/apache/incubator-airflow/pull/3863 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] kaxil closed pull request #3904: [AIRFLOW-XXX] Fix typo in docs/timezone.rst

2018-09-16 Thread GitBox
kaxil closed pull request #3904: [AIRFLOW-XXX] Fix typo in docs/timezone.rst URL: https://github.com/apache/incubator-airflow/pull/3904 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[jira] [Commented] (AIRFLOW-3059) PostgresToGCS log the number of rows

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616698#comment-16616698 ] ASF GitHub Bot commented on AIRFLOW-3059: - kaxil closed pull request #3905: [AIRFLOW-3059] Log

[jira] [Resolved] (AIRFLOW-3059) PostgresToGCS log the number of rows

2018-09-16 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3059. - Resolution: Fixed Assignee: Fokko Driesprong Fix Version/s: 2.0.0 Resolved by

[GitHub] kaxil closed pull request #3905: [AIRFLOW-3059] Log how many rows are read from Postgres

2018-09-16 Thread GitBox
kaxil closed pull request #3905: [AIRFLOW-3059] Log how many rows are read from Postgres URL: https://github.com/apache/incubator-airflow/pull/3905 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] Fokko commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2018-09-16 Thread GitBox
Fokko commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-421754322 @ndmar The reason is takes soo long to get this merged is the poor quality of the PR. Don't get me wrong, but

[GitHub] Fokko edited a comment on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code

2018-09-16 Thread GitBox
Fokko edited a comment on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code URL: https://github.com/apache/incubator-airflow/pull/2466#issuecomment-421753641 @ron819 I think it is a good idea to set the `schedule_interval`, but the link to the docs is old (refers to Airbnb).

[GitHub] Fokko commented on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code

2018-09-16 Thread GitBox
Fokko commented on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code URL: https://github.com/apache/incubator-airflow/pull/2466#issuecomment-421753641 @ron819 I think it is a good idea to set the `schedule_interval`, but the link to the docs is old (refers to AirBNB).

[GitHub] ron819 commented on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code

2018-09-16 Thread GitBox
ron819 commented on issue #2466: [AIRFLOW-1441] Fix inconsistent tutorial code URL: https://github.com/apache/incubator-airflow/pull/2466#issuecomment-421750337 @Fokko is this still relevant? This is an automated message

[GitHub] eyaltrabelsi commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2018-09-16 Thread GitBox
eyaltrabelsi commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-421746408 @Nadbkl can you add @ndmar? This is an

[jira] [Commented] (AIRFLOW-3068) Remove deprecated import mechanism

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616669#comment-16616669 ] ASF GitHub Bot commented on AIRFLOW-3068: - Fokko opened a new pull request #3906:

[GitHub] Fokko opened a new pull request #3906: [AIRFLOW-3068] Remove deprecated imports

2018-09-16 Thread GitBox
Fokko opened a new pull request #3906: [AIRFLOW-3068] Remove deprecated imports URL: https://github.com/apache/incubator-airflow/pull/3906 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] Fokko commented on issue #3905: [AIRFLOW-3059] Log how many rows are read from Postgres

2018-09-16 Thread GitBox
Fokko commented on issue #3905: [AIRFLOW-3059] Log how many rows are read from Postgres URL: https://github.com/apache/incubator-airflow/pull/3905#issuecomment-421744788 @kaxil PTAL :) This is an automated message from the

[jira] [Commented] (AIRFLOW-3059) PostgresToGCS log the number of rows

2018-09-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616637#comment-16616637 ] ASF GitHub Bot commented on AIRFLOW-3059: - Fokko opened a new pull request #3905:

[GitHub] Fokko opened a new pull request #3905: [AIRFLOW-3059] Log how many rows are read from Postgres

2018-09-16 Thread GitBox
Fokko opened a new pull request #3905: [AIRFLOW-3059] Log how many rows are read from Postgres URL: https://github.com/apache/incubator-airflow/pull/3905 To know how many data is being read from Postgres, it is nice to log this to the Airflow log. Previously when there was no

[jira] [Created] (AIRFLOW-3071) Unable to clear Val of Variable from the UI

2018-09-16 Thread jack (JIRA)
jack created AIRFLOW-3071: - Summary: Unable to clear Val of Variable from the UI Key: AIRFLOW-3071 URL: https://issues.apache.org/jira/browse/AIRFLOW-3071 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

2018-09-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616627#comment-16616627 ] jack commented on AIRFLOW-2902: --- [~XD-DENG]  is this something you can pick-up? > Add S3ToBigQuery

[GitHub] dlebech commented on issue #3890: [AIRFLOW-3049] Add extra operations for Mongo hook

2018-09-16 Thread GitBox
dlebech commented on issue #3890: [AIRFLOW-3049] Add extra operations for Mongo hook URL: https://github.com/apache/incubator-airflow/pull/3890#issuecomment-421715800 @Fokko thanks for the feedback. I've updated the parameter name and added tweaks to the documentation.

[GitHub] XD-DENG opened a new pull request #3904: [AIRFLOW-XXX] Fix typo in docs/timezone.rst

2018-09-16 Thread GitBox
XD-DENG opened a new pull request #3904: [AIRFLOW-XXX] Fix typo in docs/timezone.rst URL: https://github.com/apache/incubator-airflow/pull/3904 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-3058) Airflow log & multi-threading

2018-09-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616607#comment-16616607 ] jack commented on AIRFLOW-3058: --- [~ashb] I'm using local executor... > Airflow log & multi-threading >