[GitHub] [airflow] RosterIn commented on issue #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps()

2020-02-10 Thread GitBox
RosterIn commented on issue #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps() URL: https://github.com/apache/airflow/pull/7398#issuecomment-584514650 @damon09273 `airflow/contrib/operators/sql_to_gcs.py` doesn't exist in master (which is why you get conflict) You

[GitHub] [airflow] damon09273 closed pull request #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps()

2020-02-10 Thread GitBox
damon09273 closed pull request #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps() URL: https://github.com/apache/airflow/pull/7398 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-6505) Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034207#comment-17034207 ] ASF GitHub Bot commented on AIRFLOW-6505: - damon09273 commented on pull request #7398:

[jira] [Updated] (AIRFLOW-6505) Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread Damon Liao (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damon Liao updated AIRFLOW-6505: Description: Emoji can't be encoded properly when ` json.dumps()` and 'UTF-8', problem fixed by

[jira] [Commented] (AIRFLOW-6505) Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034196#comment-17034196 ] ASF GitHub Bot commented on AIRFLOW-6505: - damon09273 commented on pull request #7398:

[GitHub] [airflow-site] XD-DENG commented on issue #238: Typo in community page

2020-02-10 Thread GitBox
XD-DENG commented on issue #238: Typo in community page URL: https://github.com/apache/airflow-site/issues/238#issuecomment-584510155 Thanks @louisguitton This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] damon09273 opened a new pull request #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps()

2020-02-10 Thread GitBox
damon09273 opened a new pull request #7398: [AIRFLOW-6505] Let emoji encoded properly for json.dumps() URL: https://github.com/apache/airflow/pull/7398 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[airflow-site] branch master updated: Add mail list unsubscribe link (#250)

2020-02-10 Thread xddeng
This is an automated email from the ASF dual-hosted git repository. xddeng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new c598425 Add mail list unsubscribe link

[GitHub] [airflow-site] XD-DENG merged pull request #250: Add unsubscribe link

2020-02-10 Thread GitBox
XD-DENG merged pull request #250: Add unsubscribe link URL: https://github.com/apache/airflow-site/pull/250 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] damon09273 closed pull request #7397: Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread GitBox
damon09273 closed pull request #7397: Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/7397 This is an automated message from the Apache Git

[GitHub] [airflow] damon09273 opened a new pull request #7397: Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread GitBox
damon09273 opened a new pull request #7397: Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/7397 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] feluelle commented on issue #6576: [AIRFLOW-5922] Add option to specify the mysql client library used in MySqlHook

2020-02-10 Thread GitBox
feluelle commented on issue #6576: [AIRFLOW-5922] Add option to specify the mysql client library used in MySqlHook URL: https://github.com/apache/airflow/pull/6576#issuecomment-584507024 @potiuk @ashb @nuclearpinguin do you have any idea what I can do to fix the segmentation error?

[GitHub] [airflow-site] Fokko opened a new pull request #250: Add unsubscribe link

2020-02-10 Thread GitBox
Fokko opened a new pull request #250: Add unsubscribe link URL: https://github.com/apache/airflow-site/pull/250 It isn't clear how to unsubscribe from the mail list. This is an automated message from the Apache Git Service.

[airflow-site] branch master updated: Fix typo - Commiter => Committer (#247)

2020-02-10 Thread fokko
This is an automated email from the ASF dual-hosted git repository. fokko pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 72de3af Fix typo - Commiter => Committer

[GitHub] [airflow-site] Fokko commented on a change in pull request #246: Expand the guide for contributors

2020-02-10 Thread GitBox
Fokko commented on a change in pull request #246: Expand the guide for contributors URL: https://github.com/apache/airflow-site/pull/246#discussion_r377472874 ## File path: CONTRIBUTE.md ## @@ -17,9 +17,10 @@ under the License. --> -## General directory structure

[GitHub] [airflow-site] Fokko merged pull request #247: Fix typo - Commiter => Committer

2020-02-10 Thread GitBox
Fokko merged pull request #247: Fix typo - Commiter => Committer URL: https://github.com/apache/airflow-site/pull/247 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow-site] Fokko opened a new pull request #249: Remove AIP-11 in favor of master

2020-02-10 Thread GitBox
Fokko opened a new pull request #249: Remove AIP-11 in favor of master URL: https://github.com/apache/airflow-site/pull/249 I believe this is a relic from the past. I tried to click the _Suggest a change on this page_ on here: https://airflow.apache.org/community/ But I got a 404.

[jira] [Created] (AIRFLOW-6771) Error in formatting in _collect_errors

2020-02-10 Thread Gregory Golberg (Jira)
Gregory Golberg created AIRFLOW-6771: Summary: Error in formatting in _collect_errors Key: AIRFLOW-6771 URL: https://issues.apache.org/jira/browse/AIRFLOW-6771 Project: Apache Airflow

[GitHub] [airflow] jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377459173 ## File path: .travis.yml ## @@ -101,7 +101,7 @@ jobs:

[GitHub] [airflow] jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377459124 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
jithin97 commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377459152 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] potiuk commented on issue #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on issue #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#issuecomment-584491660 Thanks @jithin97 ! This is an automated message from the

[GitHub] [airflow] codecov-io commented on issue #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
codecov-io commented on issue #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#issuecomment-584488896 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7396?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377454766 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377454608 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377454957 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377454669 ## File path: scripts/ci/in_container/entrypoint_ci.sh ## @@ -211,6 +211,10 @@ fi

[GitHub] [airflow] potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396#discussion_r377454371 ## File path: .travis.yml ## @@ -101,7 +101,7 @@ jobs:

[jira] [Commented] (AIRFLOW-6770) Unable to run specific test using breeze CLI

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034126#comment-17034126 ] ASF GitHub Bot commented on AIRFLOW-6770: - jithin97 commented on pull request #7396:

[GitHub] [airflow] jithin97 opened a new pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix

2020-02-10 Thread GitBox
jithin97 opened a new pull request #7396: [AIRFLOW-6770] Run particular test using breeze CLI bug fix URL: https://github.com/apache/airflow/pull/7396 ### Description Running a particular test from breeze CLI runs all the tests within _tests/_ directory instead of running only the

[jira] [Created] (AIRFLOW-6770) Unable to run specific test using breeze CLI

2020-02-10 Thread Jithin Sukumar (Jira)
Jithin Sukumar created AIRFLOW-6770: --- Summary: Unable to run specific test using breeze CLI Key: AIRFLOW-6770 URL: https://issues.apache.org/jira/browse/AIRFLOW-6770 Project: Apache Airflow

[GitHub] [airflow] yuqian90 removed a comment on issue #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

2020-02-10 Thread GitBox
yuqian90 removed a comment on issue #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#issuecomment-579271946 This is work-in-progress and untested. I want to get some opinions from committers first to see if it's worth

[jira] [Commented] (AIRFLOW-5629) Support specify priority and priorityClassName spec in KubernetesPodOperator

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034018#comment-17034018 ] ASF GitHub Bot commented on AIRFLOW-5629: - simis2626 commented on pull request #7395:

[GitHub] [airflow] simis2626 opened a new pull request #7395: [AIRFLOW-5629] Implement K8s priorityClassName in KubernetesPo…

2020-02-10 Thread GitBox
simis2626 opened a new pull request #7395: [AIRFLOW-5629] Implement K8s priorityClassName in KubernetesPo… URL: https://github.com/apache/airflow/pull/7395 …dOperator Changes allow user to specify priority_class_name within KubernetesPodOperator which sets the Pod.spec value to

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7395: [AIRFLOW-5629] Implement K8s priorityClassName in KubernetesPo…

2020-02-10 Thread GitBox
boring-cyborg[bot] commented on issue #7395: [AIRFLOW-5629] Implement K8s priorityClassName in KubernetesPo… URL: https://github.com/apache/airflow/pull/7395#issuecomment-584409286 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any

[jira] [Assigned] (AIRFLOW-5629) Support specify priority and priorityClassName spec in KubernetesPodOperator

2020-02-10 Thread Simon Levett (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Levett reassigned AIRFLOW-5629: - Assignee: Simon Levett (was: Yaliang Wang) Working on a PR for this. > Support

[GitHub] [airflow] stale[bot] closed pull request #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2020-02-10 Thread GitBox
stale[bot] closed pull request #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/airflow/pull/2708 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-1746) Add a Nomad operator to trigger job from Airflow

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033986#comment-17033986 ] ASF GitHub Bot commented on AIRFLOW-1746: - stale[bot] commented on pull request #2708:

[GitHub] [airflow] spektom commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2020-02-10 Thread GitBox
spektom commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-584335178 > Great work @spektom, sorry it took 6 months to land! No problem, thanks for reviewing and helping shape it!

[jira] [Resolved] (AIRFLOW-5176) Add integration with Azure Data Explorer

2020-02-10 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5176. Fix Version/s: 2.0.0 Resolution: Fixed > Add integration with Azure Data

[jira] [Commented] (AIRFLOW-5176) Add integration with Azure Data Explorer

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033921#comment-17033921 ] ASF GitHub Bot commented on AIRFLOW-5176: - ashb commented on pull request #5785: [AIRFLOW-5176]

[jira] [Commented] (AIRFLOW-5176) Add integration with Azure Data Explorer

2020-02-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033922#comment-17033922 ] ASF subversion and git services commented on AIRFLOW-5176: -- Commit

[GitHub] [airflow] boring-cyborg[bot] commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2020-02-10 Thread GitBox
boring-cyborg[bot] commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-584334338 Awesome work, congrats on your first merged pull request!

[GitHub] [airflow] ashb commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2020-02-10 Thread GitBox
ashb commented on issue #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785#issuecomment-584334509 Great work @spektom, sorry it took 6 months to land! This is an

[GitHub] [airflow] ashb merged pull request #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator

2020-02-10 Thread GitBox
ashb merged pull request #5785: [AIRFLOW-5176] Add Azure Data Explorer (Kusto) operator URL: https://github.com/apache/airflow/pull/5785 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (AIRFLOW-6769) Multiple DAGs cause infinite loop in logging

2020-02-10 Thread Chris Boden (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Boden updated AIRFLOW-6769: - Description: After adding a second DAG to Airflow the scheduler spirals into an infinite loop

[jira] [Updated] (AIRFLOW-6769) Multiple DAGs cause infinite loop in logging

2020-02-10 Thread Chris Boden (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Boden updated AIRFLOW-6769: - Attachment: scheduler-dag.log > Multiple DAGs cause infinite loop in logging >

[jira] [Created] (AIRFLOW-6769) Multiple DAGs cause infinite loop in logging

2020-02-10 Thread Chris Boden (Jira)
Chris Boden created AIRFLOW-6769: Summary: Multiple DAGs cause infinite loop in logging Key: AIRFLOW-6769 URL: https://issues.apache.org/jira/browse/AIRFLOW-6769 Project: Apache Airflow

[GitHub] [airflow] stale[bot] commented on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response

2020-02-10 Thread GitBox
stale[bot] commented on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response URL: https://github.com/apache/airflow/pull/6256#issuecomment-584258610 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further

[GitHub] [airflow] blcksrx commented on issue #7358: [AIRFLOW-1202] Create Elasticsearch Hook

2020-02-10 Thread GitBox
blcksrx commented on issue #7358: [AIRFLOW-1202] Create Elasticsearch Hook URL: https://github.com/apache/airflow/pull/7358#issuecomment-584257515 Done This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] codecov-io edited a comment on issue #7358: [AIRFLOW-1202] Create Elasticsearch Hook

2020-02-10 Thread GitBox
codecov-io edited a comment on issue #7358: [AIRFLOW-1202] Create Elasticsearch Hook URL: https://github.com/apache/airflow/pull/7358#issuecomment-581934830 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7358?src=pr=h1) Report > Merging

[jira] [Assigned] (AIRFLOW-6369) clear cli command needs a 'conf' option

2020-02-10 Thread Yajna Pandith (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yajna Pandith reassigned AIRFLOW-6369: -- Assignee: Yajna Pandith > clear cli command needs a 'conf' option >

[jira] [Commented] (AIRFLOW-6767) Default workgroup name for Athena is incorrect

2020-02-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033743#comment-17033743 ] ASF subversion and git services commented on AIRFLOW-6767: -- Commit

[jira] [Resolved] (AIRFLOW-6767) Default workgroup name for Athena is incorrect

2020-02-10 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6767. Resolution: Fixed > Default workgroup name for Athena is incorrect >

[jira] [Commented] (AIRFLOW-6767) Default workgroup name for Athena is incorrect

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033741#comment-17033741 ] ASF GitHub Bot commented on AIRFLOW-6767: - mik-laj commented on pull request #7394:

[GitHub] [airflow] mik-laj merged pull request #7394: [AIRFLOW-6767] Correct name for default Athena workgroup

2020-02-10 Thread GitBox
mik-laj merged pull request #7394: [AIRFLOW-6767] Correct name for default Athena workgroup URL: https://github.com/apache/airflow/pull/7394 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] leonardoam commented on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp…

2020-02-10 Thread GitBox
leonardoam commented on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp… URL: https://github.com/apache/airflow/pull/6337#issuecomment-584208987 @potiuk branch rebased. Thx for your help!

[jira] [Commented] (AIRFLOW-5615) BaseJob subclasses shouldn't implement own heartbeat logic

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033725#comment-17033725 ] ASF GitHub Bot commented on AIRFLOW-5615: - ashb commented on pull request #6311: [AIRFLOW-5615]

[jira] [Commented] (AIRFLOW-5615) BaseJob subclasses shouldn't implement own heartbeat logic

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033724#comment-17033724 ] ASF GitHub Bot commented on AIRFLOW-5615: - stale[bot] commented on pull request #6311:

[GitHub] [airflow] ashb opened a new pull request #6311: [AIRFLOW-5615] Reduce duplicated logic around job heartbeating

2020-02-10 Thread GitBox
ashb opened a new pull request #6311: [AIRFLOW-5615] Reduce duplicated logic around job heartbeating URL: https://github.com/apache/airflow/pull/6311 ### Jira - [x] https://issues.apache.org/jira/browse/AIRFLOW-5615 ### Description - [x] Both SchedulerJob and

[GitHub] [airflow] stale[bot] closed pull request #6311: [AIRFLOW-5615] Reduce duplicated logic around job heartbeating

2020-02-10 Thread GitBox
stale[bot] closed pull request #6311: [AIRFLOW-5615] Reduce duplicated logic around job heartbeating URL: https://github.com/apache/airflow/pull/6311 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] codecov-io commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
codecov-io commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#issuecomment-584201606 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7391?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task …

2020-02-10 Thread GitBox
codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task … URL: https://github.com/apache/airflow/pull/6652#issuecomment-558277657 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6652?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task …

2020-02-10 Thread GitBox
codecov-io edited a comment on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task … URL: https://github.com/apache/airflow/pull/6652#issuecomment-558277657 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6652?src=pr=h1) Report > Merging

[GitHub] [airflow] blcksrx commented on a change in pull request #7358: [AIRFLOW-1202] Create Elasticsearch Hook

2020-02-10 Thread GitBox
blcksrx commented on a change in pull request #7358: [AIRFLOW-1202] Create Elasticsearch Hook URL: https://github.com/apache/airflow/pull/7358#discussion_r377157022 ## File path: airflow/providers/elasticsearch/hooks/elasticsearch.py ## @@ -0,0 +1,89 @@ +# +# Licensed to

[GitHub] [airflow] bhavika commented on issue #7394: [AIRFLOW-6767] Correct name for default Athena workgroup

2020-02-10 Thread GitBox
bhavika commented on issue #7394: [AIRFLOW-6767] Correct name for default Athena workgroup URL: https://github.com/apache/airflow/pull/7394#issuecomment-584197494 :wave: I'm not entirely sure how CodeCov does this but I haven't reduced the scope of any tests or deleted them so the

[GitHub] [airflow] codecov-io edited a comment on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp…

2020-02-10 Thread GitBox
codecov-io edited a comment on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp… URL: https://github.com/apache/airflow/pull/6337#issuecomment-584135185 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6337?src=pr=h1) Report > Merging

[GitHub] [airflow] blcksrx commented on a change in pull request #7358: [AIRFLOW-1202] Create Elasticsearch Hook

2020-02-10 Thread GitBox
blcksrx commented on a change in pull request #7358: [AIRFLOW-1202] Create Elasticsearch Hook URL: https://github.com/apache/airflow/pull/7358#discussion_r376952688 ## File path: airflow/providers/elasticsearch/hooks/elasticsearch.py ## @@ -0,0 +1,89 @@ +# +# Licensed to

[GitHub] [airflow] codecov-io commented on issue #7394: [AIRFLOW-6767] Correct name for default Athena workgroup

2020-02-10 Thread GitBox
codecov-io commented on issue #7394: [AIRFLOW-6767] Correct name for default Athena workgroup URL: https://github.com/apache/airflow/pull/7394#issuecomment-584195791 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7394?src=pr=h1) Report > Merging

[jira] [Comment Edited] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2020-02-10 Thread William Lachance (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033699#comment-17033699 ] William Lachance edited comment on AIRFLOW-3534 at 2/10/20 3:46 PM:

[jira] [Commented] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2020-02-10 Thread William Lachance (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033699#comment-17033699 ] William Lachance commented on AIRFLOW-3534: --- My intuition at this point is that this is an

[jira] [Commented] (AIRFLOW-6505) Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033698#comment-17033698 ] Kamil Bregula commented on AIRFLOW-6505: [~Damon09273] Can you create PR in the Apache

[jira] [Commented] (AIRFLOW-6505) Let emoji encoded properly for json.dumps() -- BaseSQLToGoogleCloudStorageOperator

2020-02-10 Thread Roster (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033694#comment-17033694 ] Roster commented on AIRFLOW-6505: - Ran into this one too and came up with this Jira [~Damon09273] i

[jira] [Commented] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2020-02-10 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033693#comment-17033693 ] Kamil Bregula commented on AIRFLOW-3534: Do you think this is somehow caused by Airflow or is

[jira] [Comment Edited] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2020-02-10 Thread William Lachance (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023334#comment-17023334 ] William Lachance edited comment on AIRFLOW-3534 at 2/10/20 3:33 PM:

[jira] [Commented] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2020-02-10 Thread William Lachance (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033689#comment-17033689 ] William Lachance commented on AIRFLOW-3534: --- I was using the latest stable version (10.0.1)

[GitHub] [airflow] ashb commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
ashb commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377129979 ## File path: MANIFEST-packages.in ## @@ -0,0 +1,24 @@ +# +# Licensed to the Apache Software Foundation

[GitHub] [airflow] codecov-io commented on issue #7321: [AIRFLOW-XXXX] Remove duplication in BaseOperator docstring

2020-02-10 Thread GitBox
codecov-io commented on issue #7321: [AIRFLOW-] Remove duplication in BaseOperator docstring URL: https://github.com/apache/airflow/pull/7321#issuecomment-584171117 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7321?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#issuecomment-584166040 Fixed comments This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377115621 ## File path: setup.py ## @@ -591,5 +594,144 @@ def do_setup(): ) +PROVIDERS_DEPENDENCIES = { +

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377112953 ## File path: scripts/ci/ci_prepare_backport_packages.sh ## @@ -0,0 +1,71 @@ +#!/usr/bin/env bash +#

[jira] [Created] (AIRFLOW-6768) Graph view rendering angular edges

2020-02-10 Thread Nathan Hadfield (Jira)
Nathan Hadfield created AIRFLOW-6768: Summary: Graph view rendering angular edges Key: AIRFLOW-6768 URL: https://issues.apache.org/jira/browse/AIRFLOW-6768 Project: Apache Airflow Issue

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377109262 ## File path: scripts/perf/sql_queries.py ## @@ -0,0 +1,178 @@ +# Licensed to the Apache

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377105680 ## File path: setup.py ## @@ -591,5 +594,144 @@ def do_setup(): ) +PROVIDERS_DEPENDENCIES = { +

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377105026 ## File path: setup.py ## @@ -591,5 +594,144 @@ def do_setup(): ) +PROVIDERS_DEPENDENCIES = { +

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377104128 ## File path: MANIFEST-packages.in ## @@ -0,0 +1,24 @@ +# +# Licensed to the Apache Software Foundation

[jira] [Commented] (AIRFLOW-6767) Default workgroup name for Athena is incorrect

2020-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033643#comment-17033643 ] ASF GitHub Bot commented on AIRFLOW-6767: - bhavika commented on pull request #7394:

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377103522 ## File path: airflow/utils/sqlalchemy.py ## @@ -20,48 +20,73 @@ import json import logging

[GitHub] [airflow] bhavika opened a new pull request #7394: [AIRFLOW-6767] Correct name for default Athena workgroup

2020-02-10 Thread GitBox
bhavika opened a new pull request #7394: [AIRFLOW-6767] Correct name for default Athena workgroup URL: https://github.com/apache/airflow/pull/7394 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
nuclearpinguin commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377101936 ## File path: airflow/models/dagrun.py ## @@ -338,15 +339,30 @@ def update_state(self,

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377101053 ## File path: setup.py ## @@ -591,5 +594,144 @@ def do_setup(): ) +PROVIDERS_DEPENDENCIES = { +

[GitHub] [airflow] potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on a change in pull request #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#discussion_r377100501 ## File path: scripts/ci/ci_prepare_backport_packages.sh ## @@ -0,0 +1,71 @@ +#!/usr/bin/env bash +#

[GitHub] [airflow] potiuk commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages

2020-02-10 Thread GitBox
potiuk commented on issue #7391: [AIRFLOW-6663] Prepare backporting packages URL: https://github.com/apache/airflow/pull/7391#issuecomment-584152145 > Something slightly odd is going on with the naming -- some are using `-`, others are using `_` > Yeah. That's default naming

[jira] [Created] (AIRFLOW-6767) Default workgroup name for Athena is incorrect

2020-02-10 Thread Bhavika (Jira)
Bhavika created AIRFLOW-6767: Summary: Default workgroup name for Athena is incorrect Key: AIRFLOW-6767 URL: https://issues.apache.org/jira/browse/AIRFLOW-6767 Project: Apache Airflow Issue

[GitHub] [airflow] mrshu commented on issue #6871: [AIRFLOW-6319] Add support for AWS Athena workgroups

2020-02-10 Thread GitBox
mrshu commented on issue #6871: [AIRFLOW-6319] Add support for AWS Athena workgroups URL: https://github.com/apache/airflow/pull/6871#issuecomment-584142723 @bhavika Nice -- thanks a lot for the reply! Please feel free to go ahead and update the `workgroup` default -- it would take

[GitHub] [airflow] codecov-io commented on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp…

2020-02-10 Thread GitBox
codecov-io commented on issue #6337: [AIRFLOW-5659] - Add support for ephemeral storage on KubernetesPodOp… URL: https://github.com/apache/airflow/pull/6337#issuecomment-584135185 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6337?src=pr=h1) Report > Merging

[GitHub] [airflow] bhavika commented on issue #6871: [AIRFLOW-6319] Add support for AWS Athena workgroups

2020-02-10 Thread GitBox
bhavika commented on issue #6871: [AIRFLOW-6319] Add support for AWS Athena workgroups URL: https://github.com/apache/airflow/pull/6871#issuecomment-584132576 @mrshu just wanted to flag that someone else already fixed the WorkGroup param name here -

[GitHub] [airflow] ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377061966 ## File path: scripts/perf/sql_queries.py ## @@ -0,0 +1,178 @@ +# Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377070248 ## File path: tests/models/test_dagrun.py ## @@ -227,15 +227,14 @@ def test_dagrun_deadlock(self):

[GitHub] [airflow] ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs

2020-02-10 Thread GitBox
ashb commented on a change in pull request #7370: [AIRFLOW-6590] Use batch db operations in jobs URL: https://github.com/apache/airflow/pull/7370#discussion_r377034240 ## File path: airflow/config_templates/config.yml ## @@ -495,6 +495,13 @@ type: string

  1   2   >