[jira] [Assigned] (AIRFLOW-3066) Add job parameters to AWSbatch Operator

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reassigned AIRFLOW-3066: -- Assignee: (was: Hugo Prudente) > Add job parameters to AWSbatch

[jira] [Updated] (AIRFLOW-5490) security.py: replace == None with is_() comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5490: --- Component/s: (was: security) webserver > security.py: replace

[GitHub] [airflow] ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#discussion_r331405404 ## File path: airflow/jobs/scheduler_job.py ## @@ -1092,7 +1099,7 @@ def

[GitHub] [airflow] ashb merged pull request #6064: [AIRFLOW-5444] Fix action_logging so that request.form for POST is logged

2019-10-04 Thread GitBox
ashb merged pull request #6064: [AIRFLOW-5444] Fix action_logging so that request.form for POST is logged URL: https://github.com/apache/airflow/pull/6064 This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] feluelle commented on issue #5994: [AIRFLOW-5395] Fix unloading with column names containing a dot in RedshiftToS3Operator

2019-10-04 Thread GitBox
feluelle commented on issue #5994: [AIRFLOW-5395] Fix unloading with column names containing a dot in RedshiftToS3Operator URL: https://github.com/apache/airflow/pull/5994#issuecomment-538339594 > @feluelle Thought if you want to "take-over" the other PR that might be better - open a new

[GitHub] [airflow] codecov-io edited a comment on issue #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst URL: https://github.com/apache/airflow/pull/6255#issuecomment-538187681 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6255?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-5595) gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU region.

2019-10-04 Thread Lenoj (Jira)
Lenoj created AIRFLOW-5595: -- Summary: gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU region. Key: AIRFLOW-5595 URL: https://issues.apache.org/jira/browse/AIRFLOW-5595 Project:

[GitHub] [airflow] ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#discussion_r331404383 ## File path: tests/jobs/test_scheduler_job.py ## @@ -2736,3 +2736,28 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#discussion_r331404053 ## File path: tests/jobs/test_scheduler_job.py ## @@ -2736,3 +2736,28 @@ def

[GitHub] [airflow] mik-laj commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks

2019-10-04 Thread GitBox
mik-laj commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks URL: https://github.com/apache/airflow/pull/6249#discussion_r331409160 ## File path: docs/operators-and-hooks-ref.rst ## @@ -22,6 +22,36 @@ Operators and Hooks Reference

[GitHub] [airflow] ashb closed pull request #5379: AIRFLOW-4316 Don't make automatically lower case every variable from …

2019-10-04 Thread GitBox
ashb closed pull request #5379: AIRFLOW-4316 Don't make automatically lower case every variable from … URL: https://github.com/apache/airflow/pull/5379 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ashb commented on issue #5379: AIRFLOW-4316 Don't make automatically lower case every variable from …

2019-10-04 Thread GitBox
ashb commented on issue #5379: AIRFLOW-4316 Don't make automatically lower case every variable from … URL: https://github.com/apache/airflow/pull/5379#issuecomment-538318307 @OmerJog No, and @houqp already finished the work which is why https://issues.apache.org/jira/browse/AIRFLOW-5055

[jira] [Commented] (AIRFLOW-4316) Keys/Variable names in the 'kubernetes_environment_variables' section are transformed to lower case

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944339#comment-16944339 ] ASF GitHub Bot commented on AIRFLOW-4316: - ashb commented on pull request #5379: AIRFLOW-4316

[GitHub] [airflow] feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst

2019-10-04 Thread GitBox
feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst URL: https://github.com/apache/airflow/pull/6255#discussion_r331413106 ## File path: docs/build.sh ## @@ -79,6 +79,63 @@ else echo fi

[GitHub] [airflow] feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst

2019-10-04 Thread GitBox
feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst URL: https://github.com/apache/airflow/pull/6255#discussion_r331412966 ## File path: docs/build.sh ## @@ -79,6 +79,63 @@ else echo fi

[GitHub] [airflow] feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst

2019-10-04 Thread GitBox
feluelle commented on a change in pull request #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst URL: https://github.com/apache/airflow/pull/6255#discussion_r331412213 ## File path: docs/build.sh ## @@ -79,6 +79,63 @@ else echo fi

[GitHub] [airflow] ashb commented on issue #6064: [AIRFLOW-5444] Fix action_logging so that request.form for POST is logged

2019-10-04 Thread GitBox
ashb commented on issue #6064: [AIRFLOW-5444] Fix action_logging so that request.form for POST is logged URL: https://github.com/apache/airflow/pull/6064#issuecomment-538325090 I'll merge this PR as it fixes a bug. `Airflow.graph`, `Airflow.clear`, `Airflow.delete` are not based on

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r331424802 ## File path: airflow/contrib/hooks/livy_hook.py ## @@ -0,0 +1,297 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] mik-laj commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks

2019-10-04 Thread GitBox
mik-laj commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks URL: https://github.com/apache/airflow/pull/6249#discussion_r331424904 ## File path: docs/operators-and-hooks-ref.rst ## @@ -22,6 +22,36 @@ Operators and Hooks Reference

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r331425013 ## File path: airflow/contrib/hooks/livy_hook.py ## @@ -0,0 +1,297 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] codecov-io commented on issue #6226: [AIRFLOW-XXX] Add message about breaking change in DAG#get_task_instances

2019-10-04 Thread GitBox
codecov-io commented on issue #6226: [AIRFLOW-XXX] Add message about breaking change in DAG#get_task_instances URL: https://github.com/apache/airflow/pull/6226#issuecomment-538336789 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6226?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb commented on issue #6230: [AIRFLOW-5413] enable K8S pod config from file

2019-10-04 Thread GitBox
ashb commented on issue #6230: [AIRFLOW-5413] enable K8S pod config from file URL: https://github.com/apache/airflow/pull/6230#issuecomment-538321723 Can we have a more descriptive PR title for this too please? Our changelog is generated from PR titles and I don't really know what "K8S pod

[GitHub] [airflow] ashb commented on issue #5044: [AIRFLOW-4240] Require POST for state-changing requests

2019-10-04 Thread GitBox
ashb commented on issue #5044: [AIRFLOW-4240] Require POST for state-changing requests URL: https://github.com/apache/airflow/pull/5044#issuecomment-538322008 @chang Someone has already created https://github.com/apache/airflow/pull/6064

[jira] [Commented] (AIRFLOW-5444) action_logging missing important fields such as Dag Id and Task Id for POST actions

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944351#comment-16944351 ] ASF GitHub Bot commented on AIRFLOW-5444: - ashb commented on pull request #6064: [AIRFLOW-5444]

[GitHub] [airflow] feluelle commented on a change in pull request #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
feluelle commented on a change in pull request #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#discussion_r331423282 ## File path: airflow/macros/__init__.py ## @@ -91,4 +92,4 @@ def _integrate_plugins():

[GitHub] [airflow] ashb merged pull request #6226: [AIRFLOW-XXX] Add message about breaking change in DAG#get_task_instances

2019-10-04 Thread GitBox
ashb merged pull request #6226: [AIRFLOW-XXX] Add message about breaking change in DAG#get_task_instances URL: https://github.com/apache/airflow/pull/6226 This is an automated message from the Apache Git Service. To respond

[jira] [Created] (AIRFLOW-5594) Remove excessive logging for connections

2019-10-04 Thread Johannes Wienke (Jira)
Johannes Wienke created AIRFLOW-5594: Summary: Remove excessive logging for connections Key: AIRFLOW-5594 URL: https://issues.apache.org/jira/browse/AIRFLOW-5594 Project: Apache Airflow

[GitHub] [airflow] arkadiuszbach commented on a change in pull request #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
arkadiuszbach commented on a change in pull request #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#discussion_r331438987 ## File path: airflow/macros/__init__.py ## @@ -91,4 +92,4 @@ def _integrate_plugins():

[GitHub] [airflow] kaxil merged pull request #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries

2019-10-04 Thread GitBox
kaxil merged pull request #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries URL: https://github.com/apache/airflow/pull/6233 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work started] (AIRFLOW-5595) gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU region.

2019-10-04 Thread Lenoj (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5595 started by Lenoj. -- > gcs_to_bq operator - Throws error when BQ dataset isn't located in US or EU > region.

[jira] [Commented] (AIRFLOW-4939) Ability to specify default retries for all tasks

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944406#comment-16944406 ] ASF GitHub Bot commented on AIRFLOW-4939: - kaxil commented on pull request #6233:

[jira] [Commented] (AIRFLOW-4939) Ability to specify default retries for all tasks

2019-10-04 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944407#comment-16944407 ] ASF subversion and git services commented on AIRFLOW-4939: -- Commit

[GitHub] [airflow] arkadiuszbach commented on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
arkadiuszbach commented on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#issuecomment-538298632 Done, removed from pylint_todo.txt This is an automated

[jira] [Updated] (AIRFLOW-5490) security.py: Fix confusing == None comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5490: --- Summary: security.py: Fix confusing == None comparison (was: security.py: Fix

[jira] [Updated] (AIRFLOW-5490) security.py: Fix incorrect None comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5490: --- Description: Note: This ticket's being created to facilitate a new contributor's

[GitHub] [airflow] ashb commented on a change in pull request #6175: [AIRFLOW-5545] Fixes recursion in DAG cycle testing

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6175: [AIRFLOW-5545] Fixes recursion in DAG cycle testing URL: https://github.com/apache/airflow/pull/6175#discussion_r331406550 ## File path: airflow/models/dag.py ## @@ -1467,22 +1467,26 @@ def _test_cycle_helper(self,

[GitHub] [airflow] ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r331424491 ## File path: airflow/utils/db.py ## @@ -200,6 +200,10 @@ def initdb(): Connection(

[GitHub] [airflow] ashb closed pull request #5189: [AIRFLOW-4415] skip status propagation

2019-10-04 Thread GitBox
ashb closed pull request #5189: [AIRFLOW-4415] skip status propagation URL: https://github.com/apache/airflow/pull/5189 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] ashb commented on issue #5189: [AIRFLOW-4415] skip status propagation

2019-10-04 Thread GitBox
ashb commented on issue #5189: [AIRFLOW-4415] skip status propagation URL: https://github.com/apache/airflow/pull/5189#issuecomment-538354175 Closing this PR as it stands as: - It has no tests. Given this is a bug fix we must have unit tests that cover it, otherwise the feature

[GitHub] [airflow] codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#issuecomment-538127848 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6252?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-5490) security.py: replace == None with is_() comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5490: --- Summary: security.py: replace == None with is_() comparison (was: security.py:

[jira] [Updated] (AIRFLOW-5488) Respect include_env and include_cmds in tmp_configuration_copy method

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5488: --- Summary: Respect include_env and include_cmds in tmp_configuration_copy method

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file URL: https://github.com/apache/airflow/pull/6230#discussion_r331412443 ## File path: airflow/executors/kubernetes_executor.py ## @@ -373,29 +183,74 @@ def run_next(self,

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file URL: https://github.com/apache/airflow/pull/6230#discussion_r331411281 ## File path: airflow/kubernetes/pod_generator.py ## @@ -62,75 +68,53 @@ class PodGenerator:

[GitHub] [airflow] ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file

2019-10-04 Thread GitBox
ashb commented on a change in pull request #6230: [AIRFLOW-5413] enable K8S pod config from file URL: https://github.com/apache/airflow/pull/6230#discussion_r331411037 ## File path: airflow/executors/kubernetes_executor.py ## @@ -45,199 +47,6 @@ MAX_LABEL_LEN = 63

[jira] [Commented] (AIRFLOW-4415) skip status stops propagation randomly.

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944411#comment-16944411 ] ASF GitHub Bot commented on AIRFLOW-4415: - ashb commented on pull request #5189: [AIRFLOW-4415]

[jira] [Updated] (AIRFLOW-5485) scheduler_job: replace == with is comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5485: --- Description: Note: This ticket's being created to facilitate a new contributor's

[jira] [Updated] (AIRFLOW-5485) scheduler_job: replace == with is comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5485: --- Description: Note: This ticket's being created to facilitate a new contributor's

[jira] [Updated] (AIRFLOW-5485) scheduler_job: replace == with is comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5485: --- Description: Note: This ticket's being created to facilitate a new contributor's

[GitHub] [airflow] codecov-io edited a comment on issue #6232: [AIRFLOW-5582] AutoCommit in jdbc is missing get_autocommit

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6232: [AIRFLOW-5582] AutoCommit in jdbc is missing get_autocommit URL: https://github.com/apache/airflow/pull/6232#issuecomment-537324813 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6232?src=pr=h1) Report > Merging

[GitHub] [airflow] robinedwards commented on issue #6195: [AIRFLOW-5560] Allow no confirmation on reset dags

2019-10-04 Thread GitBox
robinedwards commented on issue #6195: [AIRFLOW-5560] Allow no confirmation on reset dags URL: https://github.com/apache/airflow/pull/6195#issuecomment-538299364 Any conclusion on this? This is an automated message from the

[jira] [Resolved] (AIRFLOW-2541) Ability to discover custom plugins, operators, sensors, etc. from various locations

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-2541. Resolution: Done It is now possible to add plugins to Airflow from python

[jira] [Updated] (AIRFLOW-5485) scheduler_job: replace == with is_() comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5485: --- Summary: scheduler_job: replace == with is_() comparison (was: scheduler_job:

[jira] [Updated] (AIRFLOW-5485) scheduler_job: replace == None with is_() comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5485: --- Summary: scheduler_job: replace == None with is_() comparison (was:

[jira] [Commented] (AIRFLOW-5485) scheduler_job: replace == None with is_() comparison

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944325#comment-16944325 ] Ash Berlin-Taylor commented on AIRFLOW-5485: [~serkef] Yes it appears no one has made a

[jira] [Commented] (AIRFLOW-5600) Add MLEngine system tests

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944908#comment-16944908 ] ASF GitHub Bot commented on AIRFLOW-5600: - mik-laj commented on pull request #6264:

[jira] [Commented] (AIRFLOW-5598) Improve MLEngine typehint

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944901#comment-16944901 ] ASF GitHub Bot commented on AIRFLOW-5598: - mik-laj commented on pull request #6263:

[GitHub] [airflow] codecov-io edited a comment on issue #6265: [AIRFLOW-5597] Linkify urls in task instance log

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6265: [AIRFLOW-5597] Linkify urls in task instance log URL: https://github.com/apache/airflow/pull/6265#issuecomment-538605802 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6265?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6265: [AIRFLOW-5597] Linkify urls in task instance log

2019-10-04 Thread GitBox
codecov-io commented on issue #6265: [AIRFLOW-5597] Linkify urls in task instance log URL: https://github.com/apache/airflow/pull/6265#issuecomment-538605802 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6265?src=pr=h1) Report > Merging

[GitHub] [airflow] clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-10-04 Thread GitBox
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-538615069 We have solved the problem, and uncovered another problem. Working on navigating my company's open source contribution

[jira] [Commented] (AIRFLOW-5597) Linkify urls in task instance log

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944934#comment-16944934 ] ASF GitHub Bot commented on AIRFLOW-5597: - ZxMYS commented on pull request #6265:

[GitHub] [airflow] ZxMYS opened a new pull request #6265: [AIRFLOW-5597] Linkify urls in task instance log

2019-10-04 Thread GitBox
ZxMYS opened a new pull request #6265: [AIRFLOW-5597] Linkify urls in task instance log URL: https://github.com/apache/airflow/pull/6265 #6070 # Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references them in

[GitHub] [airflow] mik-laj opened a new pull request #6262: [AIRFLOW-5599] Improve Python 3 support in MLEngine integration

2019-10-04 Thread GitBox
mik-laj opened a new pull request #6262: [AIRFLOW-5599] Improve Python 3 support in MLEngine integration URL: https://github.com/apache/airflow/pull/6262 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5599) Imporve Python 3 support in MLEngine integration

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944900#comment-16944900 ] ASF GitHub Bot commented on AIRFLOW-5599: - mik-laj commented on pull request #6262:

[GitHub] [airflow] mik-laj opened a new pull request #6263: [AIRFLOW-5598] Improve MLEngine typehints

2019-10-04 Thread GitBox
mik-laj opened a new pull request #6263: [AIRFLOW-5598] Improve MLEngine typehints URL: https://github.com/apache/airflow/pull/6263 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] codecov-io commented on issue #6263: [AIRFLOW-5598] Improve MLEngine typehints

2019-10-04 Thread GitBox
codecov-io commented on issue #6263: [AIRFLOW-5598] Improve MLEngine typehints URL: https://github.com/apache/airflow/pull/6263#issuecomment-538600271 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6263?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

2019-10-04 Thread GitBox
mik-laj commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#issuecomment-538610165 Can you create a bug report in Jira? Please add the "gcp" component.

[jira] [Assigned] (AIRFLOW-4660) Make airflow/bin Pylint compatible

2019-10-04 Thread Arkadiusz Bach (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arkadiusz Bach reassigned AIRFLOW-4660: --- Assignee: Arkadiusz Bach > Make airflow/bin Pylint compatible >

[GitHub] [airflow] stpavinash commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator

2019-10-04 Thread GitBox
stpavinash commented on issue #5077: [AIRFLOW-4268] Add MsSqlToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/5077#issuecomment-538594334 I'm trying to connect to sql server instance using this operator and trying to a query a table which has got 20M records and

[jira] [Work started] (AIRFLOW-5578) The root url "/" should be configurable, not hardcoded

2019-10-04 Thread David Dossett (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5578 started by David Dossett. -- > The root url "/" should be configurable, not hardcoded >

[GitHub] [airflow] Sinsin1367 commented on a change in pull request #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod…

2019-10-04 Thread GitBox
Sinsin1367 commented on a change in pull request #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod… URL: https://github.com/apache/airflow/pull/6261#discussion_r331702649 ## File path: airflow/kubernetes/pod_launcher.py ## @@ -116,9 +124,27 @@

[jira] [Commented] (AIRFLOW-4493) emr_add_step_operator needs region_name as parameter

2019-10-04 Thread Francesco Macagno (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944869#comment-16944869 ] Francesco Macagno commented on AIRFLOW-4493: I believe this is still a problem. an aws

[jira] [Commented] (AIRFLOW-5141) KubernetesPodOperator to print resource utilization at end of job

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944867#comment-16944867 ] ASF GitHub Bot commented on AIRFLOW-5141: - Sinsin1367 commented on pull request #6261:

[jira] [Created] (AIRFLOW-5596) EmrJobFlowSensor does not allow configuring region

2019-10-04 Thread Francesco Macagno (Jira)
Francesco Macagno created AIRFLOW-5596: -- Summary: EmrJobFlowSensor does not allow configuring region Key: AIRFLOW-5596 URL: https://issues.apache.org/jira/browse/AIRFLOW-5596 Project: Apache

[jira] [Created] (AIRFLOW-5597) Linkify urls in task instance log

2019-10-04 Thread Xiao Zhu (Jira)
Xiao Zhu created AIRFLOW-5597: - Summary: Linkify urls in task instance log Key: AIRFLOW-5597 URL: https://issues.apache.org/jira/browse/AIRFLOW-5597 Project: Apache Airflow Issue Type: Wish

[jira] [Created] (AIRFLOW-5598) Improve MLEngine typehint

2019-10-04 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5598: -- Summary: Improve MLEngine typehint Key: AIRFLOW-5598 URL: https://issues.apache.org/jira/browse/AIRFLOW-5598 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-5599) Imporve Python 3 support in MLEngine integration

2019-10-04 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5599: -- Summary: Imporve Python 3 support in MLEngine integration Key: AIRFLOW-5599 URL: https://issues.apache.org/jira/browse/AIRFLOW-5599 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5600) Add MLEngine system tests

2019-10-04 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5600: -- Summary: Add MLEngine system tests Key: AIRFLOW-5600 URL: https://issues.apache.org/jira/browse/AIRFLOW-5600 Project: Apache Airflow Issue Type:

[GitHub] [airflow] codecov-io commented on issue #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod…

2019-10-04 Thread GitBox
codecov-io commented on issue #6261: [AIRFLOW-5141] Added optional resource usage logging to KubernetesPod… URL: https://github.com/apache/airflow/pull/6261#issuecomment-538590785 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6261?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj opened a new pull request #6264: [AIRFLOW-5600][depends on AIRFLOW-5598, AIRFLOW-5599] Add MLEngine system tests

2019-10-04 Thread GitBox
mik-laj opened a new pull request #6264: [AIRFLOW-5600][depends on AIRFLOW-5598,AIRFLOW-5599] Add MLEngine system tests URL: https://github.com/apache/airflow/pull/6264 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-5488) Respect include_env and include_cmds in tmp_configuration_copy method

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5488: --- Description: Note: This ticket's being created to facilitate a new contributor's

[GitHub] [airflow] feluelle commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks

2019-10-04 Thread GitBox
feluelle commented on a change in pull request #6249: [AIRFLOW-XXX] Add fundaments operators and hooks URL: https://github.com/apache/airflow/pull/6249#discussion_r331407712 ## File path: docs/operators-and-hooks-ref.rst ## @@ -22,6 +22,36 @@ Operators and Hooks Reference

[GitHub] [airflow] ashb commented on issue #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries

2019-10-04 Thread GitBox
ashb commented on issue #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries URL: https://github.com/apache/airflow/pull/6233#issuecomment-538317575 The reason the tests didn't pass was because: - At parse time the value in the config was 0 - We then run the decorator to

[jira] [Updated] (AIRFLOW-5488) Respect include_env and include_cmds in tmp_configuration_copy method

2019-10-04 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5488: --- Component/s: (was: utils) core > Respect include_env and

[GitHub] [airflow] ashb commented on issue #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries

2019-10-04 Thread GitBox
ashb commented on issue #6233: [AIRFLOW-4939] Simplify Code for Default Task Retries URL: https://github.com/apache/airflow/pull/6233#issuecomment-538317858 > in fact one would need to restart the scheduler after changing conf This is true with both code paths -- the airflow config

[GitHub] [airflow] codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#issuecomment-538127848 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6252?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6252: [AIRFLOW-4676] Make airflow/macros Pylint compatible URL: https://github.com/apache/airflow/pull/6252#issuecomment-538127848 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6252?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5444) action_logging missing important fields such as Dag Id and Task Id for POST actions

2019-10-04 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944353#comment-16944353 ] ASF subversion and git services commented on AIRFLOW-5444: -- Commit

[GitHub] [airflow] feluelle commented on issue #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst

2019-10-04 Thread GitBox
feluelle commented on issue #6255: [AIRFLOW-5592][depends on #6249] Add lint for operators-and-hooks-ref.rst URL: https://github.com/apache/airflow/pull/6255#issuecomment-538326175 @mik-laj The logic for finding those files looks good imo. But I am not an expert in `bash` so I would like

[GitHub] [airflow] codecov-io commented on issue #6257: [AIRFLOW-XXX] Split extra packages table in multiple

2019-10-04 Thread GitBox
codecov-io commented on issue #6257: [AIRFLOW-XXX] Split extra packages table in multiple URL: https://github.com/apache/airflow/pull/6257#issuecomment-538420620 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6257?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6239: [AIRFLOW-5585] Remove docker context from build

2019-10-04 Thread GitBox
codecov-io edited a comment on issue #6239: [AIRFLOW-5585] Remove docker context from build URL: https://github.com/apache/airflow/pull/6239#issuecomment-537570182 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6239?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-5575) Cannot use the mark future success/failure feature in the UI

2019-10-04 Thread Christopher Hyatt (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hyatt updated AIRFLOW-5575: --- Attachment: pip_freeze.txt > Cannot use the mark future success/failure feature in

[jira] [Commented] (AIRFLOW-5585) Docker-context file check gives only marginal improvements for build

2019-10-04 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944634#comment-16944634 ] ASF subversion and git services commented on AIRFLOW-5585: -- Commit

[jira] [Commented] (AIRFLOW-5585) Docker-context file check gives only marginal improvements for build

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944633#comment-16944633 ] ASF GitHub Bot commented on AIRFLOW-5585: - potiuk commented on pull request #6239:

[GitHub] [airflow] seelmann commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-04 Thread GitBox
seelmann commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-538412584 I finally was able to test, zombie detection works great and deterministic with the 2nd commit. Thanks

[GitHub] [airflow] codecov-io commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-04 Thread GitBox
codecov-io commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-538457664 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6259?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5585) Docker-context file check gives only marginal improvements for build

2019-10-04 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944639#comment-16944639 ] ASF subversion and git services commented on AIRFLOW-5585: -- Commit

[GitHub] [airflow] l0n3r4n83r commented on a change in pull request #6260: [AIRFLOW-XXX] Fix minor typo in slack hook

2019-10-04 Thread GitBox
l0n3r4n83r commented on a change in pull request #6260: [AIRFLOW-XXX] Fix minor typo in slack hook URL: https://github.com/apache/airflow/pull/6260#discussion_r331581263 ## File path: README.md ## @@ -124,6 +124,7 @@ Currently **officially** using Airflow: 1.

[GitHub] [airflow] feluelle merged pull request #6243: [AIRFLOW-XXX] Highlight code blocks

2019-10-04 Thread GitBox
feluelle merged pull request #6243: [AIRFLOW-XXX] Highlight code blocks URL: https://github.com/apache/airflow/pull/6243 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] davlum commented on issue #6196: [AIRFLOW-3152] Kubernetes Pod Operator should support init containers.

2019-10-04 Thread GitBox
davlum commented on issue #6196: [AIRFLOW-3152] Kubernetes Pod Operator should support init containers. URL: https://github.com/apache/airflow/pull/6196#issuecomment-538418468 1. Yeah, I'm referring to those custom objects. Each of them duplicates code that is available in

  1   2   >