[GitHub] ron819 commented on issue #2040: [AIRFLOW-808] - SqlToS3 Operator

2018-11-28 Thread GitBox
ron819 commented on issue #2040: [AIRFLOW-808] - SqlToS3 Operator URL: https://github.com/apache/incubator-airflow/pull/2040#issuecomment-442736153 @abnerrolim are you still working on this PR? This is an automated message

[GitHub] ron819 commented on issue #2256: [AIRFLOW-1153] Fix issue ' params ' don't pass to HiveOperator execution context

2018-11-28 Thread GitBox
ron819 commented on issue #2256: [AIRFLOW-1153] Fix issue ' params ' don't pass to HiveOperator execution context URL: https://github.com/apache/incubator-airflow/pull/2256#issuecomment-442735846 @xianping are you still working on this PR?

[GitHub] XD-DENG commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
XD-DENG commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#discussion_r237376869 ## File path: airflow/contrib/sensors/aws_athena_sensor.py ## @@ -0,0 +1,77 @@ +# -*- coding: utf-8

[GitHub] XD-DENG commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
XD-DENG commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#discussion_r237376620 ## File path: airflow/contrib/sensors/aws_athena_sensor.py ## @@ -0,0 +1,77 @@ +# -*- coding: utf-8

[jira] [Commented] (AIRFLOW-2546) Set logging level correctly to avoid no section error

2018-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702800#comment-16702800 ] ASF GitHub Bot commented on AIRFLOW-2546: - feng-tao closed pull request #3443: [AIRFLOW-2546]

[GitHub] feng-tao commented on issue #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error

2018-11-28 Thread GitBox
feng-tao commented on issue #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error URL: https://github.com/apache/incubator-airflow/pull/3443#issuecomment-442728680 this pr is no longer needed as it is fixed by another pr.

[GitHub] feng-tao closed pull request #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error

2018-11-28 Thread GitBox
feng-tao closed pull request #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error URL: https://github.com/apache/incubator-airflow/pull/3443 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[GitHub] ron819 commented on issue #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error

2018-11-28 Thread GitBox
ron819 commented on issue #3443: [AIRFLOW-2546] Set logging level correctly to avoid no section error URL: https://github.com/apache/incubator-airflow/pull/3443#issuecomment-442728440 What's the status of this PR? This is

[GitHub] ron819 commented on issue #3088: [AIRFLOW-2167] cleanup nonexistent import errors on the first iteration in addition to periodically

2018-11-28 Thread GitBox
ron819 commented on issue #3088: [AIRFLOW-2167] cleanup nonexistent import errors on the first iteration in addition to periodically URL: https://github.com/apache/incubator-airflow/pull/3088#issuecomment-442728016 @caseybrown89 are you still working on this PR?

[GitHub] KevinYang21 commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
KevinYang21 commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234#issuecomment-442727454 @feng-tao ty and ty for the reviews you have done. We have ~1600 active DAGs after some recent pruning and we

[GitHub] feluelle commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
feluelle commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#discussion_r237369388 ## File path: airflow/contrib/sensors/aws_athena_sensor.py ## @@ -0,0 +1,77 @@ +# -*- coding: utf-8

[GitHub] feluelle commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
feluelle commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#discussion_r237369725 ## File path: docs/code.rst ## @@ -224,6 +224,7 @@ Sensors .. autoclass::

[GitHub] feng-tao commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
feng-tao commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234#issuecomment-442722528 BTW, pr nicely done! This is an automated message

[GitHub] feng-tao commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
feng-tao commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234#issuecomment-442722462 hey @KevinYang21 , I discussed with Max and heard that Airbnb run 2000+ dag in prod daily. I wonder what's the setup

[GitHub] yeluolei commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker

2018-11-28 Thread GitBox
yeluolei commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker URL: https://github.com/apache/incubator-airflow/pull/3675#issuecomment-442713648 @ashb is that means we should not use this Dockerfile to build docker image of airflow, instead we should create one by

[GitHub] codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api.

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api. URL: https://github.com/apache/incubator-airflow/pull/4232#issuecomment-441683534 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4232?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api.

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api. URL: https://github.com/apache/incubator-airflow/pull/4232#issuecomment-441683534 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4232?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api.

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4232: [AIRFLOW-3390] Add connections to api. URL: https://github.com/apache/incubator-airflow/pull/4232#issuecomment-441683534 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4232?src=pr=h1) Report > Merging

[GitHub] jmcarp commented on issue #4207: [AIRFLOW-3367] Run celery integration test with redis broker.

2018-11-28 Thread GitBox
jmcarp commented on issue #4207: [AIRFLOW-3367] Run celery integration test with redis broker. URL: https://github.com/apache/incubator-airflow/pull/4207#issuecomment-442699347 Conflicts fixed, ready for another look @ashb.

[GitHub] r39132 commented on issue #4252: [AIRFLOW-XXX] Add Poshmark to Companies

2018-11-28 Thread GitBox
r39132 commented on issue #4252: [AIRFLOW-XXX] Add Poshmark to Companies URL: https://github.com/apache/incubator-airflow/pull/4252#issuecomment-442699320 @msadityan Welcome to the community! This is an automated message

[GitHub] r39132 closed pull request #4252: [AIRFLOW-XXX] Add Poshmark to Companies

2018-11-28 Thread GitBox
r39132 closed pull request #4252: [AIRFLOW-XXX] Add Poshmark to Companies URL: https://github.com/apache/incubator-airflow/pull/4252 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[jira] [Updated] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana updated AIRFLOW-3415: -- Description: When triggering dagruns in a loop, the imported references become null on the

[jira] [Updated] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana updated AIRFLOW-3415: -- Description: When triggering dagruns in a loop, the imported references become null on the

[jira] [Updated] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana updated AIRFLOW-3415: -- Description: When triggering dagruns in a loop, the imported references become null on the

[jira] [Updated] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana updated AIRFLOW-3415: -- Description: When triggering dagruns in a loop, the imported references become null on the

[jira] [Updated] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana updated AIRFLOW-3415: -- Description: When triggering dagruns in a loop, the imported references become null on the

[jira] [Closed] (AIRFLOW-166) Webserver times out using systemd script

2018-11-28 Thread Yuri Bendana (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuri Bendana closed AIRFLOW-166. Resolution: Fixed > Webserver times out using systemd script >

[jira] [Created] (AIRFLOW-3415) Imports become null when triggering dagruns in a loop

2018-11-28 Thread Yuri Bendana (JIRA)
Yuri Bendana created AIRFLOW-3415: - Summary: Imports become null when triggering dagruns in a loop Key: AIRFLOW-3415 URL: https://issues.apache.org/jira/browse/AIRFLOW-3415 Project: Apache Airflow

[GitHub] codecov-io edited a comment on issue #4207: [AIRFLOW-3367] Run celery integration test with redis broker.

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4207: [AIRFLOW-3367] Run celery integration test with redis broker. URL: https://github.com/apache/incubator-airflow/pull/4207#issuecomment-439668923 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4207?src=pr=h1) Report > Merging

[GitHub] Gauravshah commented on a change in pull request #4252: Add Poshmark to Companies

2018-11-28 Thread GitBox
Gauravshah commented on a change in pull request #4252: Add Poshmark to Companies URL: https://github.com/apache/incubator-airflow/pull/4252#discussion_r237336413 ## File path: README.md ## @@ -265,6 +265,7 @@ Currently **officially** using Airflow: 1.

[GitHub] dlamblin commented on issue #2304: Add in animation for running dags.

2018-11-28 Thread GitBox
dlamblin commented on issue #2304: Add in animation for running dags. URL: https://github.com/apache/incubator-airflow/pull/2304#issuecomment-442684996 Because the commit message in the PR should start with [AIRFLOW-0123456789] referencing the [jira

[GitHub] ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2018-11-28 Thread GitBox
ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-442679796 @ramSeraph -- Unfortunately, this has also been pushed back for me (my team) at the moment, so you're welcome

[GitHub] KevinYang21 opened a new pull request #4253: [WIP][AIRFLOW-3414] Fix reload_module in DagFileProcessorAgent

2018-11-28 Thread GitBox
KevinYang21 opened a new pull request #4253: [WIP][AIRFLOW-3414] Fix reload_module in DagFileProcessorAgent URL: https://github.com/apache/incubator-airflow/pull/4253 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-3414) reload_module not working with custom logging class

2018-11-28 Thread Kevin Yang (JIRA)
Kevin Yang created AIRFLOW-3414: --- Summary: reload_module not working with custom logging class Key: AIRFLOW-3414 URL: https://issues.apache.org/jira/browse/AIRFLOW-3414 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-3271) Airflow RBAC Permissions modification via UI do not persist

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3271: Fix Version/s: (was: 1.10.2) 2.0.0 > Airflow RBAC Permissions

[GitHub] KevinYang21 commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
KevinYang21 commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234#issuecomment-442654588 I would vote +1 to include so that we have a complete story around scaling in 1.10.2

[GitHub] esthernamrm commented on a change in pull request #4231: [AIRFLOW-3066] Adding support for AWS Batch parameters

2018-11-28 Thread GitBox
esthernamrm commented on a change in pull request #4231: [AIRFLOW-3066] Adding support for AWS Batch parameters URL: https://github.com/apache/incubator-airflow/pull/4231#discussion_r237308334 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -74,6 +79,7

[GitHub] msadityan opened a new pull request #4252: Add Poshmark to Companies

2018-11-28 Thread GitBox
msadityan opened a new pull request #4252: Add Poshmark to Companies URL: https://github.com/apache/incubator-airflow/pull/4252 **Jira** No Jira issue. Add Poshmark to companies list. **Description** This PR adds Poshmark to the companies list in the README.md. **Tests**

[GitHub] LoicAG commented on a change in pull request #4245: [AIRFLOW-3404] Add Amazon SES support

2018-11-28 Thread GitBox
LoicAG commented on a change in pull request #4245: [AIRFLOW-3404] Add Amazon SES support URL: https://github.com/apache/incubator-airflow/pull/4245#discussion_r237289172 ## File path: setup.py ## @@ -225,6 +225,7 @@ def write_version(filename=os.path.join(*['airflow',

[jira] [Updated] (AIRFLOW-2761) Parallelize Celery Executor enqueuing

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2761: Component/s: celery > Parallelize Celery Executor enqueuing >

[jira] [Commented] (AIRFLOW-2399) TriggerDagRunOperator Should Permit Implementor to Choose Dag Id at Runtime

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702446#comment-16702446 ] Kaxil Naik commented on AIRFLOW-2399: - Resolved by

[jira] [Updated] (AIRFLOW-2399) TriggerDagRunOperator Should Permit Implementor to Choose Dag Id at Runtime

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2399: External issue URL: (was: https://github.com/apache/incubator-airflow/pull/4228) >

[jira] [Updated] (AIRFLOW-2399) TriggerDagRunOperator Should Permit Implementor to Choose Dag Id at Runtime

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2399: External issue URL: https://github.com/apache/incubator-airflow/pull/4228 >

[GitHub] kaxil commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
kaxil commented on issue #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234#issuecomment-442628187 @Fokko Thoughts on including this to 1.10.2 ??? This is

[GitHub] kaxil closed pull request #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor

2018-11-28 Thread GitBox
kaxil closed pull request #4234: [AIRFLOW-2761] Parallelize enqueue in celery executor URL: https://github.com/apache/incubator-airflow/pull/4234 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] kaxil commented on a change in pull request #4245: [AIRFLOW-3404] Add Amazon SES support

2018-11-28 Thread GitBox
kaxil commented on a change in pull request #4245: [AIRFLOW-3404] Add Amazon SES support URL: https://github.com/apache/incubator-airflow/pull/4245#discussion_r237284263 ## File path: setup.py ## @@ -225,6 +225,7 @@ def write_version(filename=os.path.join(*['airflow',

[GitHub] kaxil commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
kaxil commented on a change in pull request #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#discussion_r237282759 ## File path: airflow/contrib/sensors/aws_athena_senseor.py ## @@ -0,0 +1,63 @@ +# -*- coding: utf-8 -*-

[GitHub] kaxil commented on a change in pull request #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator

2018-11-28 Thread GitBox
kaxil commented on a change in pull request #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator URL: https://github.com/apache/incubator-airflow/pull/4251#discussion_r237281052 ## File path: airflow/contrib/hooks/gcp_sql_hook.py ## @@ -254,6 +254,54 @@ def

[GitHub] kaxil commented on a change in pull request #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator

2018-11-28 Thread GitBox
kaxil commented on a change in pull request #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator URL: https://github.com/apache/incubator-airflow/pull/4251#discussion_r237281005 ## File path: airflow/contrib/hooks/gcp_sql_hook.py ## @@ -254,6 +254,54 @@ def

[jira] [Assigned] (AIRFLOW-3408) Systemd setup instructions mention deprecated variable

2018-11-28 Thread Anoop Pillai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Pillai reassigned AIRFLOW-3408: - Assignee: Anoop Pillai > Systemd setup instructions mention deprecated variable >

[GitHub] KevinYang21 commented on issue #3214: [AIRFLOW-1325] Add ElasticSearch log handler and reader

2018-11-28 Thread GitBox
KevinYang21 commented on issue #3214: [AIRFLOW-1325] Add ElasticSearch log handler and reader URL: https://github.com/apache/incubator-airflow/pull/3214#issuecomment-442602904 @ashb Got it, I'll be working on it this week.

[jira] [Updated] (AIRFLOW-3413) Airflow sometimes doesn't know when pod has completed when using KubernetesPodOperator.

2018-11-28 Thread Trent Telfer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trent Telfer updated AIRFLOW-3413: -- Description: Currently running airflow in a docker container on an Ubuntu VM. When using the

[jira] [Updated] (AIRFLOW-3413) Airflow sometimes doesn't know when pod has completed when using KubernetesPodOperator.

2018-11-28 Thread Trent Telfer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trent Telfer updated AIRFLOW-3413: -- Description: Currently running airflow in a docker container on an Ubuntu VM. When using the

[GitHub] tal181 commented on issue #4244: [AIRFLOW-3403] Create Athena sensor

2018-11-28 Thread GitBox
tal181 commented on issue #4244: [AIRFLOW-3403] Create Athena sensor URL: https://github.com/apache/incubator-airflow/pull/4244#issuecomment-442570739 Hi @XD-DENG can you please merge this PR (if no more changes are required)

[GitHub] kppullin commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker

2018-11-28 Thread GitBox
kppullin commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker URL: https://github.com/apache/incubator-airflow/pull/3675#issuecomment-44242 That'd likely work well. I could use the `deploy.sh` script to bootstrap the system in minikube (postgresql, secrets, etc)

[GitHub] feng-tao commented on issue #4250: [AIRFLOW-XXX] Add VeeR VR to org list in README

2018-11-28 Thread GitBox
feng-tao commented on issue #4250: [AIRFLOW-XXX] Add VeeR VR to org list in README URL: https://github.com/apache/incubator-airflow/pull/4250#issuecomment-442541892 thanks @pishilong and @XD-DENG This is an automated

[GitHub] feng-tao closed pull request #4250: [AIRFLOW-XXX] Add VeeR VR to org list in README

2018-11-28 Thread GitBox
feng-tao closed pull request #4250: [AIRFLOW-XXX] Add VeeR VR to org list in README URL: https://github.com/apache/incubator-airflow/pull/4250 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] ashb commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker

2018-11-28 Thread GitBox
ashb commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker URL: https://github.com/apache/incubator-airflow/pull/3675#issuecomment-442540418 Couldn't you get even quicker dev cycles by volume-mounting the airflow code in? rather than having to rebuild?

[GitHub] kppullin commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker

2018-11-28 Thread GitBox
kppullin commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker URL: https://github.com/apache/incubator-airflow/pull/3675#issuecomment-442537550 I ran across this same issue and created a duplicate PR: https://github.com/apache/incubator-airflow/pull/4248 While

[GitHub] vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition

2018-11-28 Thread GitBox
vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition URL: https://github.com/apache/incubator-airflow/pull/3994#discussion_r237183776 ## File path:

[jira] [Resolved] (AIRFLOW-3410) Remote Host Identification Has Changed Error while using SSHOperator

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3410. - Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/4249 > Remote

[jira] [Commented] (AIRFLOW-3410) Remote Host Identification Has Changed Error while using SSHOperator

2018-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702139#comment-16702139 ] ASF GitHub Bot commented on AIRFLOW-3410: - kaxil closed pull request #4249: [AIRFLOW-3410] Add

[GitHub] kaxil closed pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
kaxil closed pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249#discussion_r237166274 ## File path: docs/howto/manage-connections.rst ## @@ -350,3 +350,51 @@ Extra

[jira] [Commented] (AIRFLOW-3372) Unable to start airflow scheduler

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702109#comment-16702109 ] Ash Berlin-Taylor commented on AIRFLOW-3372: The problem is that {{airflow initdb}} has

[jira] [Created] (AIRFLOW-3413) Airflow sometimes doesn't know when pod has completed when using KubernetesPodOperator.

2018-11-28 Thread Trent Telfer (JIRA)
Trent Telfer created AIRFLOW-3413: - Summary: Airflow sometimes doesn't know when pod has completed when using KubernetesPodOperator. Key: AIRFLOW-3413 URL: https://issues.apache.org/jira/browse/AIRFLOW-3413

[GitHub] ashb commented on issue #3214: [AIRFLOW-1325] Add ElasticSearch log handler and reader

2018-11-28 Thread GitBox
ashb commented on issue #3214: [AIRFLOW-1325] Add ElasticSearch log handler and reader URL: https://github.com/apache/incubator-airflow/pull/3214#issuecomment-442475919 By "remove this vendored dep" I mean can we remove tests/utils/log/elasticmock.py and pull in the version from pypi (I

[GitHub] vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition

2018-11-28 Thread GitBox
vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition URL: https://github.com/apache/incubator-airflow/pull/3994#discussion_r237115993 ## File path:

[GitHub] vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition

2018-11-28 Thread GitBox
vardancse commented on a change in pull request #3994: [AIRFLOW-3136] Add retry_number to TaskInstance Key property to avoid race condition URL: https://github.com/apache/incubator-airflow/pull/3994#discussion_r237114514 ## File path:

[jira] [Closed] (AIRFLOW-1092) {{execution_date}} not matching '%Y-%m-%d %H:%M:%S.%f'

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor closed AIRFLOW-1092. -- Resolution: Information Provided > {{execution_date}} not matching '%Y-%m-%d

[GitHub] xnuinside commented on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
xnuinside commented on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#issuecomment-442432897 @ashb , tests passsed This is an

[GitHub] codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#issuecomment-441625148 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4238?src=pr=h1) Report

[GitHub] codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#issuecomment-441625148 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4238?src=pr=h1) Report

[GitHub] kaxil commented on issue #4224: [AIRFLOW-3396] Make sql param as required in BigQueryOperator

2018-11-28 Thread GitBox
kaxil commented on issue #4224: [AIRFLOW-3396] Make sql param as required in BigQueryOperator URL: https://github.com/apache/incubator-airflow/pull/4224#issuecomment-442427769 ping @Fokko This is an automated message from

[GitHub] kaxil commented on issue #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
kaxil commented on issue #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249#issuecomment-442426737 @ashb Updated :) This is an automated message

[GitHub] kaxil commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
kaxil commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249#discussion_r237056259 ## File path: docs/howto/manage-connections.rst ## @@ -350,3 +350,51 @@ Extra

[jira] [Commented] (AIRFLOW-3405) Task instance fail intermittently due to MySQL error

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701772#comment-16701772 ] Ash Berlin-Taylor commented on AIRFLOW-3405: 1.10.0 -

[jira] [Commented] (AIRFLOW-3405) Task instance fail intermittently due to MySQL error

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701769#comment-16701769 ] Ash Berlin-Taylor commented on AIRFLOW-3405: The first thing I would suggest trying is

[jira] [Resolved] (AIRFLOW-3233) Dag deletion in the UI doesn't work

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-3233. Resolution: Fixed Fix Version/s: 2.0.0 1.10.2 > Dag

[GitHub] xnuinside commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
xnuinside commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#discussion_r237049395 ## File path: airflow/security/kerberos.py ## @@ -80,10 +82,8 @@

[GitHub] ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249#discussion_r237047102 ## File path: docs/howto/manage-connections.rst ## @@ -350,3 +350,51 @@ Extra

[GitHub] ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4249: [AIRFLOW-3410] Add feature to allow Host Key Change for SSH Op URL: https://github.com/apache/incubator-airflow/pull/4249#discussion_r237046841 ## File path: docs/howto/manage-connections.rst ## @@ -350,3 +350,51 @@ Extra

[GitHub] ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#discussion_r237042420 ## File path: airflow/security/kerberos.py ## @@ -80,10 +82,8 @@ def

[jira] [Commented] (AIRFLOW-3409) Docker build script should build web assets (compile_assets).

2018-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701726#comment-16701726 ] ASF GitHub Bot commented on AIRFLOW-3409: - ashb closed pull request #4248: [AIRFLOW-3409] Build

[GitHub] ashb closed pull request #4248: [AIRFLOW-3409] Build docker iamge with 'compile_assets' defined

2018-11-28 Thread GitBox
ashb closed pull request #4248: [AIRFLOW-3409] Build docker iamge with 'compile_assets' defined URL: https://github.com/apache/incubator-airflow/pull/4248 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] ashb commented on issue #4248: [AIRFLOW-3409] Build docker iamge with 'compile_assets' defined

2018-11-28 Thread GitBox
ashb commented on issue #4248: [AIRFLOW-3409] Build docker iamge with 'compile_assets' defined URL: https://github.com/apache/incubator-airflow/pull/4248#issuecomment-442411184 Three is a duplicate issue of this already, and additionally: this docker image is designed for CI, not for

[jira] [Closed] (AIRFLOW-3409) Docker build script should build web assets (compile_assets).

2018-11-28 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor closed AIRFLOW-3409. -- Resolution: Duplicate > Docker build script should build web assets

[jira] [Assigned] (AIRFLOW-987) `airflow kerberos` ignores --keytab and --principal arguments

2018-11-28 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-987: -- Assignee: Iuliia Volkova > `airflow kerberos` ignores --keytab and --principal

[jira] [Commented] (AIRFLOW-1951) kerberos keytab , principal command line argument not getting passed to run function

2018-11-28 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701715#comment-16701715 ] Iuliia Volkova commented on AIRFLOW-1951: -

[GitHub] ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#discussion_r237037414 ## File path: tests/security/test_kerberos.py ## @@ -32,13 +33,26 @@

[GitHub] ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
ashb commented on a change in pull request #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#discussion_r237037414 ## File path: tests/security/test_kerberos.py ## @@ -32,13 +33,26 @@

[jira] [Assigned] (AIRFLOW-1951) kerberos keytab , principal command line argument not getting passed to run function

2018-11-28 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-1951: --- Assignee: Iuliia Volkova > kerberos keytab , principal command line argument not

[jira] [Created] (AIRFLOW-3412) Worker pods are not being deleted after termination

2018-11-28 Thread Viktor (JIRA)
Viktor created AIRFLOW-3412: --- Summary: Worker pods are not being deleted after termination Key: AIRFLOW-3412 URL: https://issues.apache.org/jira/browse/AIRFLOW-3412 Project: Apache Airflow Issue

[GitHub] xnuinside commented on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
xnuinside commented on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#issuecomment-442407627 @ashb, please review This is an

[GitHub] codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos…

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4238: [AIRFLOW-987] pass kerberos cli args keytab and principal to kerberos… URL: https://github.com/apache/incubator-airflow/pull/4238#issuecomment-441625148 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4238?src=pr=h1) Report

[jira] [Updated] (AIRFLOW-3346) Add gcp transfer service hook and operators

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3346: Issue Type: New Feature (was: Bug) > Add gcp transfer service hook and operators >

[jira] [Updated] (AIRFLOW-3306) Disable unused flask-sqlalchemy modification tracking

2018-11-28 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3306: Issue Type: Improvement (was: Bug) > Disable unused flask-sqlalchemy modification tracking >

[GitHub] ron819 commented on issue #2798: [AIRFLOW-1061] Remove BASE_URL from log_url and mark_success_url

2018-11-28 Thread GitBox
ron819 commented on issue #2798: [AIRFLOW-1061] Remove BASE_URL from log_url and mark_success_url URL: https://github.com/apache/incubator-airflow/pull/2798#issuecomment-442392629 @jacopofar can you rebase? This is an

[jira] [Commented] (AIRFLOW-3384) Allow higher versions of sqlalchemy and jinja

2018-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701631#comment-16701631 ] ASF GitHub Bot commented on AIRFLOW-3384: - ashb closed pull request #4227: [AIRFLOW-3384] Allow

[GitHub] codecov-io edited a comment on issue #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator

2018-11-28 Thread GitBox
codecov-io edited a comment on issue #4251: [AIRFLOW-2440] Google Cloud SQL import/export operator URL: https://github.com/apache/incubator-airflow/pull/4251#issuecomment-442388853 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4251?src=pr=h1) Report > Merging

  1   2   >