[jira] [Comment Edited] (AIRFLOW-2813) `pip install apache-airflow` fails

2018-08-29 Thread Shubham Gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595969#comment-16595969 ] Shubham Gupta edited comment on AIRFLOW-2813 at 8/29/18 6:07 AM: - It 

[GitHub] Fokko commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
Fokko commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416843410 @gerardo This does not make sense to me. Why are we installing both 2 and 3 in the ci image?

[GitHub] gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416848261 @Fokko The only reason 2 versions are being installed is that I wanted to follow the CI process as close as it was

[jira] [Commented] (AIRFLOW-2813) `pip install apache-airflow` fails

2018-08-29 Thread Shubham Gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595969#comment-16595969 ] Shubham Gupta commented on AIRFLOW-2813: Since it was left out in [{{PyPi}} 

[GitHub] Fokko commented on issue #3816: [AIRFLOW-2973] Use Python 3.6.x everywhere possible

2018-08-29 Thread GitBox
Fokko commented on issue #3816: [AIRFLOW-2973] Use Python 3.6.x everywhere possible URL: https://github.com/apache/incubator-airflow/pull/3816#issuecomment-416848015 This will add a lot of load to Travis, which we don't really want since Apache infra has to pay for this. My suggestion

[GitHub] gerardo commented on a change in pull request #3393: [AIRFLOW-2499] Dockerised CI pipeline

2018-08-29 Thread GitBox
gerardo commented on a change in pull request #3393: [AIRFLOW-2499] Dockerised CI pipeline URL: https://github.com/apache/incubator-airflow/pull/3393#discussion_r189708965 ## File path: airflow/operators/python_operator.py ## @@ -300,9 +300,9 @@ def _write_args(self,

[GitHub] kaxil edited a comment on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
kaxil edited a comment on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416848426 @gerado I already tried changing that, it says python3.6 interpreter not found. Here is the link to the

[GitHub] gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416850685 @kaxil mmm, it seems it needs to be installed in the system to be used:

[jira] [Created] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread jack (JIRA)
jack created AIRFLOW-2975: - Summary: Add support for Amazon cloudwatch (computing power at will) Key: AIRFLOW-2975 URL: https://issues.apache.org/jira/browse/AIRFLOW-2975 Project: Apache Airflow

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-08-29 Thread GitBox
gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-416836140 For future reference. This looks good: https://github.com/kubernetes-sigs/kubeadm-dind-cluster > If you're an

[GitHub] Fokko commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-08-29 Thread GitBox
Fokko commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-416842865 Nice one @gerardo I'm also working on getting rid of tox, since we now have docker-compose and tox, which both act

[GitHub] kaxil commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
kaxil commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416851457 Would you be able to do that if you have got time? This

[jira] [Commented] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596093#comment-16596093 ] Ash Berlin-Taylor commented on AIRFLOW-2975: Airflow already has support for "queues" on

[GitHub] msumit closed pull request #3790: [AIRFLOW-2994] Fix command status check in Qubole Check operator

2018-08-29 Thread GitBox
msumit closed pull request #3790: [AIRFLOW-2994] Fix command status check in Qubole Check operator URL: https://github.com/apache/incubator-airflow/pull/3790 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] msumit commented on issue #3790: [AIRFLOW-2994] Fix command status check in Qubole Check operator

2018-08-29 Thread GitBox
msumit commented on issue #3790: [AIRFLOW-2994] Fix command status check in Qubole Check operator URL: https://github.com/apache/incubator-airflow/pull/3790#issuecomment-416881295 lgtm This is an automated message from the

[GitHub] msumit commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
msumit commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416882661 @andscoop can you please add a couple of specs for the change or have a strong reason for not adding.

[GitHub] ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416884461 Isn't this what the `airflow upgradedb` command already does?

[GitHub] ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416884983 Additionally why _just_ the connections? And do we need a separate setting for this? Could we not just reuse the

[GitHub] msumit commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
msumit commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416891061 @ashb IMO examples and connections are 2 different entities altogether, and we should keep them different.

[GitHub] Fokko closed pull request #3570: [AIRFLOW-2709] Improve error handling in Databricks hook

2018-08-29 Thread GitBox
Fokko closed pull request #3570: [AIRFLOW-2709] Improve error handling in Databricks hook URL: https://github.com/apache/incubator-airflow/pull/3570 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[jira] [Commented] (AIRFLOW-2709) Improve error handling in Databricks hook

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596029#comment-16596029 ] ASF GitHub Bot commented on AIRFLOW-2709: - Fokko closed pull request #3570: [AIRFLOW-2709]

[jira] [Resolved] (AIRFLOW-2709) Improve error handling in Databricks hook

2018-08-29 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2709. --- Resolution: Fixed > Improve error handling in Databricks hook >

[GitHub] Fokko commented on issue #3747: [AIRFLOW-2895] Prevent scheduler from spamming heartbeats/logs

2018-08-29 Thread GitBox
Fokko commented on issue #3747: [AIRFLOW-2895] Prevent scheduler from spamming heartbeats/logs URL: https://github.com/apache/incubator-airflow/pull/3747#issuecomment-416858185 Thanks @ashb My suggestion would be to branch of the 1.10 branch and cherry-pick some commits into this

[jira] [Comment Edited] (AIRFLOW-2813) `pip install apache-airflow` fails

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596084#comment-16596084 ] Ash Berlin-Taylor edited comment on AIRFLOW-2813 at 8/29/18 8:44 AM:

[GitHub] gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
gerardo commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416851866 @kaxil sure! I have time this week to work on this.

[GitHub] Fokko closed pull request #3697: [AIRFLOW-2854] kubernetes_pod_operator add more configuration items

2018-08-29 Thread GitBox
Fokko closed pull request #3697: [AIRFLOW-2854] kubernetes_pod_operator add more configuration items URL: https://github.com/apache/incubator-airflow/pull/3697 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2854) kubernetes_pod_operator add more configuration items

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596042#comment-16596042 ] ASF GitHub Bot commented on AIRFLOW-2854: - Fokko closed pull request #3697: [AIRFLOW-2854]

[jira] [Resolved] (AIRFLOW-2854) kubernetes_pod_operator add more configuration items

2018-08-29 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2854. --- Resolution: Fixed > kubernetes_pod_operator add more configuration items >

[GitHub] Fokko commented on issue #3806: [AIRFLOW-2956] added kubernetes tolerations to kubernetes pod operator

2018-08-29 Thread GitBox
Fokko commented on issue #3806: [AIRFLOW-2956] added kubernetes tolerations to kubernetes pod operator URL: https://github.com/apache/incubator-airflow/pull/3806#issuecomment-416857089 @justinholmes can you resolve the merge conflicts?

[GitHub] Fokko commented on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference

2018-08-29 Thread GitBox
Fokko commented on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference URL: https://github.com/apache/incubator-airflow/pull/3767#issuecomment-416857563 It looks like the tests are failing: ``` == 24)

[GitHub] Fokko commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
Fokko commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416859152 @gerardo On the `incubator-airflow-ci` we can create two branches, one for Python 2 and one for Python 3. I can

[jira] [Commented] (AIRFLOW-2813) `pip install apache-airflow` fails

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596084#comment-16596084 ] Ash Berlin-Taylor commented on AIRFLOW-2813: The page you linked to [~y2k-shubham] lists

[GitHub] ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416898406 Can you think of a case where you'd want to load the Example DAGs but not the example connections? Or the inverse,

[jira] [Created] (AIRFLOW-2976) pipy docker dependency broken

2018-08-29 Thread Lin, Yi-Li (JIRA)
Lin, Yi-Li created AIRFLOW-2976: --- Summary: pipy docker dependency broken Key: AIRFLOW-2976 URL: https://issues.apache.org/jira/browse/AIRFLOW-2976 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-2976) pipy docker dependency broken

2018-08-29 Thread Lin, Yi-Li (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin, Yi-Li updated AIRFLOW-2976: Description: I'm trying to install airflow with docker extras but airflow's dependency will

[GitHub] XD-DENG commented on issue #3793: [AIRFLOW-2948] Arg check & better doc - SSHOperator & SFTPOperator

2018-08-29 Thread GitBox
XD-DENG commented on issue #3793: [AIRFLOW-2948] Arg check & better doc - SSHOperator & SFTPOperator URL: https://github.com/apache/incubator-airflow/pull/3793#issuecomment-416921926 Hi @feng-tao may you take another look? Thanks!

[jira] [Commented] (AIRFLOW-372) DAGs can run before start_date time

2018-08-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596261#comment-16596261 ] jack commented on AIRFLOW-372: -- The recommendation I got when I started using airflow is to never mess with

[jira] [Updated] (AIRFLOW-2977) Airflow Webserver Behind Reverse Proxy with SSL Termination

2018-08-29 Thread Micheal Ascah (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micheal Ascah updated AIRFLOW-2977: --- Description: Currently, there is no way in Airflow to configure gunicorn to allow it to

[jira] [Updated] (AIRFLOW-2771) S3Hook Broad Exception Silent Failure

2018-08-29 Thread Micheal Ascah (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micheal Ascah updated AIRFLOW-2771: --- Fix Version/s: 1.10.0 > S3Hook Broad Exception Silent Failure >

[GitHub] ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416933769 > create an Airflow instance with dockerized solutions, init'ing without the example connections is preferable

[GitHub] msumit commented on issue #3779: [AIRFLOW-2928] replace uuid1 with uuid4 for better randomness

2018-08-29 Thread GitBox
msumit commented on issue #3779: [AIRFLOW-2928] replace uuid1 with uuid4 for better randomness URL: https://github.com/apache/incubator-airflow/pull/3779#issuecomment-416957588 lgtm This is an automated message from the

[jira] [Commented] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596401#comment-16596401 ] Jon Davies commented on AIRFLOW-2978: - That made it work, thanks. > Airflow deps breaking on

[jira] [Commented] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596347#comment-16596347 ] Ash Berlin-Taylor commented on AIRFLOW-2978: Check for one of these options

[GitHub] andscoop commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
andscoop commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416929571 @ashb As it becomes easier to tear down and create an Airflow instance with dockerized solutions, init'ing

[GitHub] ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
ashb commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416951818 Since I didn't say so I think the goal of this ticket is . Ah the RBAC code there is an interesting one.

[GitHub] msumit closed pull request #3779: [AIRFLOW-2928] replace uuid1 with uuid4 for better randomness

2018-08-29 Thread GitBox
msumit closed pull request #3779: [AIRFLOW-2928] replace uuid1 with uuid4 for better randomness URL: https://github.com/apache/incubator-airflow/pull/3779 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2928) Use uuid.uuid4 to create unique job name

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596342#comment-16596342 ] ASF GitHub Bot commented on AIRFLOW-2928: - msumit closed pull request #3779: [AIRFLOW-2928]

[GitHub] andscoop commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation

2018-08-29 Thread GitBox
andscoop commented on issue #3796: [AIRFLOW-2824] - Add config to disable default conn creation URL: https://github.com/apache/incubator-airflow/pull/3796#issuecomment-416944894 @ashb I made an assumption that the [logic happening after the example connection

[GitHub] tzulberti-jampp commented on a change in pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings

2018-08-29 Thread GitBox
tzulberti-jampp commented on a change in pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings URL: https://github.com/apache/incubator-airflow/pull/3795#discussion_r213700702 ## File path: airflow/www/static/main.css ## @@ -262,3 +262,4 @@

[jira] [Commented] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596216#comment-16596216 ] jack commented on AIRFLOW-2975: --- [~ashb] How can I optimize the number of workers? 1 per core? > Add

[jira] [Commented] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596344#comment-16596344 ] Jon Davies commented on AIRFLOW-2978: - We have this in setup.py: {code:java} install_requires = [

[jira] [Commented] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596223#comment-16596223 ] Ash Berlin-Taylor commented on AIRFLOW-2975: It depends on your workload - if you are

[jira] [Commented] (AIRFLOW-2030) dbapi_hook KeyError: 'i' at line 225

2018-08-29 Thread Micheal Ascah (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596296#comment-16596296 ] Micheal Ascah commented on AIRFLOW-2030: For anyone checking on this, this was actually

[jira] [Updated] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Davies updated AIRFLOW-2978: Summary: Airflow deps breaking on ancient Python packages (was: Airflow deps breaking on

[jira] [Updated] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Davies updated AIRFLOW-2978: Description: I have a Python package that depends on Airflow that forms part of our DAG build

[jira] [Created] (AIRFLOW-2978) Airflow deps breaking on ancient Package packages

2018-08-29 Thread Jon Davies (JIRA)
Jon Davies created AIRFLOW-2978: --- Summary: Airflow deps breaking on ancient Package packages Key: AIRFLOW-2978 URL: https://issues.apache.org/jira/browse/AIRFLOW-2978 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596349#comment-16596349 ] Jon Davies commented on AIRFLOW-2978: - Sorry, this is with "python setup.py test". > Airflow deps

[jira] [Updated] (AIRFLOW-2977) Airflow Webserver Behind Reverse Proxy with SSL Termination

2018-08-29 Thread Micheal Ascah (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micheal Ascah updated AIRFLOW-2977: --- Description: Currently, there is no way in Airflow to configure gunicorn to allow it to

[jira] [Created] (AIRFLOW-2977) Airflow Webserver Behind Reverse Proxy with SSL Termination

2018-08-29 Thread Micheal Ascah (JIRA)
Micheal Ascah created AIRFLOW-2977: -- Summary: Airflow Webserver Behind Reverse Proxy with SSL Termination Key: AIRFLOW-2977 URL: https://issues.apache.org/jira/browse/AIRFLOW-2977 Project: Apache

[jira] [Updated] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Davies updated AIRFLOW-2978: Description: I have a Python package that depends on Airflow that forms part of our DAG build

[jira] [Commented] (AIRFLOW-2978) Airflow deps breaking on ancient Python packages

2018-08-29 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596337#comment-16596337 ] Ash Berlin-Taylor commented on AIRFLOW-2978: What command/requirements line etc did you use

[jira] [Commented] (AIRFLOW-81) Scheduler blackout time period

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596510#comment-16596510 ] ASF GitHub Bot commented on AIRFLOW-81: --- andscoop opened a new pull request #3702: [AIRFLOW-81] Add

[jira] [Commented] (AIRFLOW-81) Scheduler blackout time period

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596509#comment-16596509 ] ASF GitHub Bot commented on AIRFLOW-81: --- andscoop closed pull request #3702: [AIRFLOW-81] Add

[GitHub] andscoop removed a comment on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
andscoop removed a comment on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702#issuecomment-417002423 @Fokko I think that is the correct way to solve this issue - with the trade off that it will involve

[GitHub] kaxil commented on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible

2018-08-29 Thread GitBox
kaxil commented on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible URL: https://github.com/apache/incubator-airflow/pull/3816#issuecomment-417009027 Yes sorry for that, I was trying to fix the issue and then debugged that it was related to our Docker CI setup and

[jira] [Commented] (AIRFLOW-2955) Kubernetes pod operator: Unable to set requests/limits on task pods

2018-08-29 Thread Jon Davies (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596597#comment-16596597 ] Jon Davies commented on AIRFLOW-2955: - Hello Daniel Imberman, Here is an example task I'm trying

[GitHub] andscoop commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
andscoop commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702#issuecomment-417003684 @Fokko I think that is the more complete solution in this case, it will just involve more thought around `start_date` and `end_date`

[jira] [Commented] (AIRFLOW-2949) Syntax Highlight for Single Quote

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596569#comment-16596569 ] ASF GitHub Bot commented on AIRFLOW-2949: - feng-tao closed pull request #3795: [AIRFLOW-2949]

[GitHub] feng-tao closed pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings

2018-08-29 Thread GitBox
feng-tao closed pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings URL: https://github.com/apache/incubator-airflow/pull/3795 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] feng-tao commented on a change in pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings

2018-08-29 Thread GitBox
feng-tao commented on a change in pull request #3795: [AIRFLOW-2949] Add syntax highlight for single quote strings URL: https://github.com/apache/incubator-airflow/pull/3795#discussion_r213747480 ## File path: airflow/www/static/main.css ## @@ -262,3 +262,4 @@ div.square

[GitHub] codecov-io edited a comment on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702#issuecomment-410552388 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3702?src=pr=h1) Report > Merging

[GitHub] tedmiston commented on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible

2018-08-29 Thread GitBox
tedmiston commented on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible URL: https://github.com/apache/incubator-airflow/pull/3816#issuecomment-416992698 @Fokko That makes sense, and I agree with you there. I reassigned the ["upgrade to 3.6" Jira

[GitHub] kaxil commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
kaxil commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-417006519 That's awesome @gerardo . Looking forward for it. @tedmiston Great. Would love to see Py3.7 PR, I think #3816 can

[GitHub] tedmiston commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs

2018-08-29 Thread GitBox
tedmiston commented on issue #3815: [AIRFLOW-2973] Add Python 3.6 to Supported Prog Langs URL: https://github.com/apache/incubator-airflow/pull/3815#issuecomment-416993877 @kaxil Sure. Btw, I've started a 3.7 test branch currently living here -

[GitHub] kaxil edited a comment on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible

2018-08-29 Thread GitBox
kaxil edited a comment on issue #3816: [HOLD][AIRFLOW-2973] Use Python 3.6.x everywhere possible URL: https://github.com/apache/incubator-airflow/pull/3816#issuecomment-417009027 Yes sorry for that, I was trying to fix the issue and then debugged that it was related to our Docker CI

[GitHub] andscoop closed pull request #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
andscoop closed pull request #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] andscoop opened a new pull request #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
andscoop opened a new pull request #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] andscoop commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-29 Thread GitBox
andscoop commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702#issuecomment-417002423 @Fokko I think that is the correct way to solve this issue - with the trade off that it will involve

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-08-29 Thread GitBox
dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417026819 @gerardo Minikube definitely will not run inside docker (there's such thing as "docker in docker" but it's a really bad

[GitHub] YingboWang commented on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-08-29 Thread GitBox
YingboWang commented on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3798#issuecomment-417042685 @yrqls21 Thanks for your comments. Just made modification and added another test case for update_state().

[GitHub] feng-tao closed pull request #3793: [AIRFLOW-2948] Arg check & better doc - SSHOperator & SFTPOperator

2018-08-29 Thread GitBox
feng-tao closed pull request #3793: [AIRFLOW-2948] Arg check & better doc - SSHOperator & SFTPOperator URL: https://github.com/apache/incubator-airflow/pull/3793 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[GitHub] codecov-io commented on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference

2018-08-29 Thread GitBox
codecov-io commented on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference URL: https://github.com/apache/incubator-airflow/pull/3818#issuecomment-417109229 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3818?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md URL: https://github.com/apache/incubator-airflow/pull/3819#issuecomment-417110927 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3819?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-2981) TypeError in dataflow operators when using GCS jar or py_file

2018-08-29 Thread Jeffrey Payne (JIRA)
Jeffrey Payne created AIRFLOW-2981: -- Summary: TypeError in dataflow operators when using GCS jar or py_file Key: AIRFLOW-2981 URL: https://issues.apache.org/jira/browse/AIRFLOW-2981 Project: Apache

[GitHub] kaxil commented on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference

2018-08-29 Thread GitBox
kaxil commented on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference URL: https://github.com/apache/incubator-airflow/pull/3818#issuecomment-417109434 Docs for `HiveOperator` can now be seen

[GitHub] codecov-io commented on issue #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md

2018-08-29 Thread GitBox
codecov-io commented on issue #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md URL: https://github.com/apache/incubator-airflow/pull/3819#issuecomment-417110927 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3819?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference URL: https://github.com/apache/incubator-airflow/pull/3818#issuecomment-417109229 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3818?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3798#issuecomment-417061518 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3798?src=pr=h1) Report >

[jira] [Created] (AIRFLOW-2979) Deprecated Celery Option not in Options list

2018-08-29 Thread Micheal Ascah (JIRA)
Micheal Ascah created AIRFLOW-2979: -- Summary: Deprecated Celery Option not in Options list Key: AIRFLOW-2979 URL: https://issues.apache.org/jira/browse/AIRFLOW-2979 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2948) Arg checking & better doc for SSHOperator and SFTPOperator

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596758#comment-16596758 ] ASF GitHub Bot commented on AIRFLOW-2948: - feng-tao closed pull request #3793: [AIRFLOW-2948]

[jira] [Updated] (AIRFLOW-2979) Deprecated Celery Option not in Options list

2018-08-29 Thread Micheal Ascah (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micheal Ascah updated AIRFLOW-2979: --- Description: References AIRFLOW-1840 In airflow/configuration.py {code:java} # A

[GitHub] kaxil opened a new pull request #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference

2018-08-29 Thread GitBox
kaxil opened a new pull request #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference URL: https://github.com/apache/incubator-airflow/pull/3818 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-2980) Missing operators in the docs

2018-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596820#comment-16596820 ] ASF GitHub Bot commented on AIRFLOW-2980: - kaxil opened a new pull request #3818:

[GitHub] kaxil opened a new pull request #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md

2018-08-29 Thread GitBox
kaxil opened a new pull request #3819: [AIRFLOW-XXX] Fix Broken Link in CONTRIBUTING.md URL: https://github.com/apache/incubator-airflow/pull/3819 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] mascah edited a comment on issue #3549: [AIRFLOW-1840] Support back-compat on old celery config

2018-08-29 Thread GitBox
mascah edited a comment on issue #3549: [AIRFLOW-1840] Support back-compat on old celery config URL: https://github.com/apache/incubator-airflow/pull/3549#issuecomment-417080253 This looks like it's missing the option for `celery_result_backend` -> `result_backend`

[GitHub] codecov-io commented on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-08-29 Thread GitBox
codecov-io commented on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3798#issuecomment-417061518 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3798?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3798: [AIRFLOW-2951] Update dag_run table end_date when state change URL: https://github.com/apache/incubator-airflow/pull/3798#issuecomment-417061518 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3798?src=pr=h1) Report >

[jira] [Updated] (AIRFLOW-2595) Oracle to Azure Blob Storage Transfer Operator

2018-08-29 Thread Marcus Rehm (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Rehm updated AIRFLOW-2595: - Description: Like MySQLToHveTransfer  operator would be nice to have a

[GitHub] codecov-io edited a comment on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference

2018-08-29 Thread GitBox
codecov-io edited a comment on issue #3818: [AIRFLOW-2980] ReadTheDocs - Fix Missing API Reference URL: https://github.com/apache/incubator-airflow/pull/3818#issuecomment-417109229 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3818?src=pr=h1) Report > Merging

[GitHub] gerardo commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption.

2018-08-29 Thread GitBox
gerardo commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption. URL: https://github.com/apache/incubator-airflow/pull/3805#issuecomment-417157895 @jakahn this PR makes things pretty confusing, as AWS has a product called [KMS](https://aws.amazon.com/kms/) as well,

  1   2   3   >