[GitHub] ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys.

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/airflow/pull/4225#discussion_r249108558 ## File path: airflow/bin/cli.py ## @@ -2109,7 +2120,12 @@ class CLIFactory(object): 'func':

[jira] [Created] (AIRFLOW-3729) Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread Bruno Campos (JIRA)
Bruno Campos created AIRFLOW-3729: - Summary: Support env variables with pod runtime information in KubernetesPodOperator Key: AIRFLOW-3729 URL: https://issues.apache.org/jira/browse/AIRFLOW-3729

[GitHub] potiuk commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
potiuk commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#issuecomment-455621176 Ok. Cool. It's good to disagree sometimes as it might lead to better final results :). I can do those things now:

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078245 ## File path: tests/core.py ## @@ -1807,6 +1819,11 @@ def tearDown(self): @unittest.skip(reason="Skipping

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249076362 ## File path: airflow/models/__init__.py ## @@ -703,6 +644,57 @@ def __init__(self, task, execution_date,

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249076129 ## File path: airflow/models/__init__.py ## @@ -703,6 +644,57 @@ def __init__(self, task, execution_date,

[jira] [Commented] (AIRFLOW-3729) Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746458#comment-16746458 ] ASF GitHub Bot commented on AIRFLOW-3729: - bbcbruno commented on pull request #4554:

[GitHub] bbcbruno opened a new pull request #4554: [AIRFLOW-3729] Support env variables with pod runtime information in KubernetesPodOperator

2019-01-18 Thread GitBox
bbcbruno opened a new pull request #4554: [AIRFLOW-3729] Support env variables with pod runtime information in KubernetesPodOperator URL: https://github.com/apache/airflow/pull/4554 ### Jira - [X] https://issues.apache.org/jira/browse/AIRFLOW-3729 ### Description - [X]

[jira] [Resolved] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-3591. Resolution: Fixed Fix Version/s: 1.10.3 > Fix start date, end date,

[GitHub] ashb merged pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread GitBox
ashb merged pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks URL: https://github.com/apache/airflow/pull/4502 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746484#comment-16746484 ] ASF subversion and git services commented on AIRFLOW-3591: -- Commit

[GitHub] ashb commented on a change in pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4502: [AIRFLOW-3591] Fix start date, end date, duration for rescheduled tasks URL: https://github.com/apache/airflow/pull/4502#discussion_r249115654 ## File path: airflow/www/views.py ## @@ -1728,33 +1728,15 @@ def gantt(self,

[jira] [Assigned] (AIRFLOW-3391) Upgrade pendulum to latest major version

2019-01-18 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand reassigned AIRFLOW-3391: Assignee: Bolke de Bruin > Upgrade pendulum to latest major version >

[GitHub] Fokko commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
Fokko commented on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#issuecomment-455506851 Having to regularly invalidate the cache would take away a couple of my concerns. Good to see that we can script the advanced

[jira] [Commented] (AIRFLOW-3541) Include --useAvroLogicalTypes setting for the Airflow operator GoogleCloudStorageToBigQueryOperator

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746267#comment-16746267 ] ASF GitHub Bot commented on AIRFLOW-3541: - BrechtDeVlieger commented on pull request #4553:

[GitHub] BrechtDeVlieger opened a new pull request #4553: [AIRFLOW-3541] Add Avro logical type conversion to bigquery hook

2019-01-18 Thread GitBox
BrechtDeVlieger opened a new pull request #4553: [AIRFLOW-3541] Add Avro logical type conversion to bigquery hook URL: https://github.com/apache/airflow/pull/4553 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Resolved] (AIRFLOW-1383) CLI clear command always resets DAG runs

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-1383. Resolution: Duplicate > CLI clear command always resets DAG runs >

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746465#comment-16746465 ] Ash Berlin-Taylor commented on AIRFLOW-2319: The unique constraint on (dag_id,exec_date) is

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112432 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY .

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112331 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY .

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112795 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY .

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249112971 ## File path: Dockerfile ## @@ -16,26 +16,77 @@ FROM python:3.6-slim -COPY .

[GitHub] ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#discussion_r249111627 ## File path: .dockerignore ## @@ -0,0 +1,23 @@ +# +# Licensed to the Apache Software

[GitHub] codecov-io edited a comment on issue #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#issuecomment-454115923 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4523?src=pr=h1) Report > Merging

[GitHub] r39132 merged pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py

2019-01-18 Thread GitBox
r39132 merged pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py URL: https://github.com/apache/airflow/pull/4552 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] ashb commented on issue #4475: [AIRFLOW-3602] Changes ImapHook to raise an exception on no attachments

2019-01-18 Thread GitBox
ashb commented on issue #4475: [AIRFLOW-3602] Changes ImapHook to raise an exception on no attachments URL: https://github.com/apache/airflow/pull/4475#issuecomment-455605712 ```bash $ mkdir tmp $ ls tmp/ $ echo $? 0 ```

[GitHub] r39132 commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
r39132 commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455617713 @dargueta I'll try to find some time to verify this on a linux VM and get back to you. In the meantime, can you resolve the conflicts? if it

[GitHub] codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-450633941 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4396?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4396: [AIRFLOW-3585] - Adding edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-450633941 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4396?src=pr=h1) Report > Merging

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249077794 ## File path: airflow/models/__init__.py ## @@ -4189,16 +4243,18 @@ def create_dagrun(self,

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078557 ## File path: tests/www/test_views.py ## @@ -728,15 +728,22 @@ def __init__(self, test, endpoint): def

[GitHub] Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
Fokko commented on a change in pull request #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#discussion_r249078144 ## File path: tests/core.py ## @@ -107,7 +107,17 @@ def execute(*args, **kwargs): class

[GitHub] ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys.

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/airflow/pull/4225#discussion_r249108075 ## File path: tests/models.py ## @@ -2991,27 +2993,118 @@ def test_xcom_get_many(self):

[jira] [Commented] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746483#comment-16746483 ] ASF GitHub Bot commented on AIRFLOW-3591: - ashb commented on pull request #4502: [AIRFLOW-3591]

[jira] [Closed] (AIRFLOW-3728) double comma in function `to_csv` in hive_hooks.py

2019-01-18 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-3728. Resolution: Fixed > double comma in function `to_csv` in hive_hooks.py >

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109494 ## File path: docs/howto/manage-connections.rst ## @@ -151,6 +156,29 @@ Scopes (comma separated)

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109716 ## File path: tests/models.py ## @@ -3077,6 +3077,23 @@ def

[GitHub] ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4523: [AIRFLOW-3616] Add aliases for schema with underscore URL: https://github.com/apache/airflow/pull/4523#discussion_r249109381 ## File path: docs/howto/manage-connections.rst ## @@ -70,10 +70,15 @@ When referencing the

[jira] [Assigned] (AIRFLOW-3718) Make official Airflow Image multi-layered

2019-01-18 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong reassigned AIRFLOW-3718: - Assignee: Jarek Potiuk > Make official Airflow Image multi-layered >

[GitHub] abitrolly commented on issue #4548: [AIRFLOW-3724] Fix the broken refresh button on Graph View in RBAC UI

2019-01-18 Thread GitBox
abitrolly commented on issue #4548: [AIRFLOW-3724] Fix the broken refresh button on Graph View in RBAC UI URL: https://github.com/apache/airflow/pull/4548#issuecomment-455504778 > We don't test UI stuff currently Hmm..

[GitHub] abitrolly edited a comment on issue #4548: [AIRFLOW-3724] Fix the broken refresh button on Graph View in RBAC UI

2019-01-18 Thread GitBox
abitrolly edited a comment on issue #4548: [AIRFLOW-3724] Fix the broken refresh button on Graph View in RBAC UI URL: https://github.com/apache/airflow/pull/4548#issuecomment-455504778 > We don't test UI stuff currently Hmm..

[jira] [Commented] (AIRFLOW-2955) Kubernetes pod operator: Unable to set requests/limits on task pods

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746185#comment-16746185 ] ASF GitHub Bot commented on AIRFLOW-2955: - suensummit commented on pull request #4551:

[GitHub] suensummit opened a new pull request #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
suensummit opened a new pull request #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-3604) Azure Integration - Hdinsight-operators

2019-01-18 Thread Alikemal Ocalan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alikemal Ocalan updated AIRFLOW-3604: - Labels: Azure features operators (was: features) > Azure Integration -

[GitHub] Fokko edited a comment on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image

2019-01-18 Thread GitBox
Fokko edited a comment on issue #4543: [AIRFLOW-3718] Multi-layered version of the docker image URL: https://github.com/apache/airflow/pull/4543#issuecomment-455506851 Having to regularly invalidate the cache would take away a couple of my concerns. Good to see that we can script the

[GitHub] zhongjiajie opened a new pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py

2019-01-18 Thread GitBox
zhongjiajie opened a new pull request #4552: [Airflow 3728] remove double comma in hive_hooks.py URL: https://github.com/apache/airflow/pull/4552 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] stale[bot] commented on issue #3367: [AIRFLOW-2475] Reference triggered dag when using TriggerDagRunOperator

2019-01-18 Thread GitBox
stale[bot] commented on issue #3367: [AIRFLOW-2475] Reference triggered dag when using TriggerDagRunOperator URL: https://github.com/apache/airflow/pull/3367#issuecomment-43114 This issue has been automatically marked as stale because it has not had recent activity. It will be closed

[jira] [Work started] (AIRFLOW-3718) Make official Airflow Image multi-layered

2019-01-18 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3718 started by Fokko Driesprong. - > Make official Airflow Image multi-layered >

[jira] [Created] (AIRFLOW-3728) double comma in function `to_csv` in hive_hooks.py

2019-01-18 Thread zhongjiajie (JIRA)
zhongjiajie created AIRFLOW-3728: Summary: double comma in function `to_csv` in hive_hooks.py Key: AIRFLOW-3728 URL: https://issues.apache.org/jira/browse/AIRFLOW-3728 Project: Apache Airflow

[GitHub] codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io commented on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-3726) Change the description and the default value for broker_url in airflow.cfg

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746532#comment-16746532 ] Ash Berlin-Taylor commented on AIRFLOW-3726: 4.1 added support for it back

[GitHub] dargueta commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
dargueta commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455650114 This isn't my PR, unfortunately. @Fokko could you fix the conflicts and change the pinning to `>= 4.10.0, <5.0`? I think 5.x will work but it's

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746638#comment-16746638 ] Ash Berlin-Taylor commented on AIRFLOW-2319: My guess as to what happened: someone added

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178779 ## File path: setup.py ## @@ -335,10 +383,8 @@ def do_setup(): 'all_dbs': all_dbs,

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177730 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ##

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178310 ## File path: setup.py ## @@ -157,30 +160,29 @@ def

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178692 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177814 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ##

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249178124 ## File path: docs/installation.rst ## @@ -56,6 +56,10 @@ Here's the list of the subpackages and

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177942 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
ashb commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249177607 ## File path: UPDATING.md ## @@ -24,6 +24,15 @@ assists users migrating to a new version. ##

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746574#comment-16746574 ] Andreas Költringer commented on AIRFLOW-2319: - Well, as of now, on the master branch, the

[GitHub] codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4551: [AIRFLOW-2955] Fix kubernetes pod operator to set requests and limits on task pods URL: https://github.com/apache/airflow/pull/4551#issuecomment-455531251 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4551?src=pr=h1) Report > Merging

[GitHub] criccomini commented on issue #4549: [AIRFLOW-3725] Add private_key to bigquery_hook get_pandas_df

2019-01-18 Thread GitBox
criccomini commented on issue #4549: [AIRFLOW-3725] Add private_key to bigquery_hook get_pandas_df URL: https://github.com/apache/airflow/pull/4549#issuecomment-455658442 Failures in CI test are K8s issues that are unrelated to this PR and are currently failing on master:

[jira] [Commented] (AIRFLOW-2876) Bump version of Tenacity

2019-01-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746527#comment-16746527 ] Ash Berlin-Taylor commented on AIRFLOW-2876: If we work with v5 (and I think we would) we

[GitHub] zihengCat opened a new pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md

2019-01-18 Thread GitBox
zihengCat opened a new pull request #4555: [AIRFLOW-XXX] Add Firestone Inventing as a Big Data & AI company uses Apache Airflow into README.md URL: https://github.com/apache/airflow/pull/4555 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the

[GitHub] dargueta edited a comment on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
dargueta edited a comment on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455650114 This isn't my PR, unfortunately. @Fokko could you fix the conflicts and change the pinning to `>= 4.11.0, <5.0`? I think 5.x will work

[jira] [Comment Edited] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746574#comment-16746574 ] Andreas Költringer edited comment on AIRFLOW-2319 at 1/18/19 7:07 PM:

[GitHub] max-sixty commented on issue #4511: [AIRFLOW-3695] Replace Flake8 by Pylint

2019-01-18 Thread GitBox
max-sixty commented on issue #4511: [AIRFLOW-3695] Replace Flake8 by Pylint URL: https://github.com/apache/airflow/pull/4511#issuecomment-455671280 I haven't been involved as an airflow developer, but saw this on the mailing list and thought it would be helpful to comment given my

[GitHub] villasv commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12

2019-01-18 Thread GitBox
villasv commented on issue #3723: [AIRFLOW-2876] Update Tenacity to 4.12 URL: https://github.com/apache/airflow/pull/3723#issuecomment-455660200 In #4217 I’ve tried to use tenacity>5 and tests didn’t pass. Also the example HttpOperator DAG breaks.

[GitHub] Licht-T commented on issue #2906: [AIRFLOW-1956] Add parameter whether the navbar clock time is UTC

2019-01-18 Thread GitBox
Licht-T commented on issue #2906: [AIRFLOW-1956] Add parameter whether the navbar clock time is UTC URL: https://github.com/apache/airflow/pull/2906#issuecomment-455737905 @nmcalabroso @ron819 Now the navbar clock follows the Airflow internal timezone setting. Should I change the

[GitHub] zhongjiajie commented on issue #4552: [Airflow 3728] remove double comma in hive_hooks.py

2019-01-18 Thread GitBox
zhongjiajie commented on issue #4552: [Airflow 3728] remove double comma in hive_hooks.py URL: https://github.com/apache/airflow/pull/4552#issuecomment-455742265 > For minor changes, you can just use AIRFLOW-XXX as the jira - no need to create a JIRA. @r39132 Ok, next time I will

[GitHub] codecov-io edited a comment on issue #4550: [Airflow 3714] Correct DAG name in docs/start.rst

2019-01-18 Thread GitBox
codecov-io edited a comment on issue #4550: [Airflow 3714] Correct DAG name in docs/start.rst URL: https://github.com/apache/airflow/pull/4550#issuecomment-455434092 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4550?src=pr=h1) Report > Merging

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249203936 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*-

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249197669 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4494: [AIRFLOW-3284] Azure Batch AI Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4494: [AIRFLOW-3284] Azure Batch AI Operator URL: https://github.com/apache/airflow/pull/4494#discussion_r249207779 ## File path: airflow/contrib/operators/azure_batchai_operator.py ## @@ -0,0 +1,190 @@ +# -*- coding: utf-8

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249219842 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249192231 ## File path: setup.py ## @@ -157,30 +160,29 @@ def

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249195694 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216549 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249216301 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218710 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249197669 ## File path: airflow/utils/log/s3_task_handler.py ## @@ -45,7 +45,7 @@ def _build_hook(self):

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4524: [AIRFLOW-3707] Group subpackages by cloud providers URL: https://github.com/apache/airflow/pull/4524#discussion_r249193359 ## File path: setup.py ## @@ -211,27 +217,44 @@ def

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249204162 ## File path: airflow/contrib/operators/aks_operator.py ## @@ -0,0 +1,200 @@ +# -*-

[jira] [Created] (AIRFLOW-3730) Improper use of logs mechanisms.

2019-01-18 Thread Kamil Bregula (JIRA)
Kamil Bregula created AIRFLOW-3730: -- Summary: Improper use of logs mechanisms. Key: AIRFLOW-3730 URL: https://issues.apache.org/jira/browse/AIRFLOW-3730 Project: Apache Airflow Issue Type:

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249218208 ## File path: airflow/contrib/operators/azure_livysparksubmit_operator.py

[GitHub] mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4530: [AIRFLOW-3282] Implement Azure Kubernetes Service Operator URL: https://github.com/apache/airflow/pull/4530#discussion_r249205505 ## File path: setup.py ## @@ -337,6 +342,7 @@ def do_setup(): 'async':

[jira] [Commented] (AIRFLOW-3730) Improper use of logs mechanisms.

2019-01-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746765#comment-16746765 ] ASF GitHub Bot commented on AIRFLOW-3730: - mik-laj commented on pull request #4556:

[GitHub] mik-laj opened a new pull request #4556: [AIRFLOW-3730] Standarization use of logs mechanisms

2019-01-18 Thread GitBox
mik-laj opened a new pull request #4556: [AIRFLOW-3730] Standarization use of logs mechanisms URL: https://github.com/apache/airflow/pull/4556 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] feng-tao commented on issue #4396: [AIRFLOW-3585] - Add edges to database

2019-01-18 Thread GitBox
feng-tao commented on issue #4396: [AIRFLOW-3585] - Add edges to database URL: https://github.com/apache/airflow/pull/4396#issuecomment-455718628 Just catching up with this pr. This seems to a very big change. I might miss the email, but do you think that it may be a good idea to discuss

[GitHub] mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-01-18 Thread GitBox
mik-laj commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r249215973 ## File path: airflow/contrib/hooks/azure_hdinsight_hook.py ## @@

  1   2   >