[GitHub] [hudi] codecov-io commented on pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
codecov-io commented on pull request #2731: URL: https://github.com/apache/hudi/pull/2731#issuecomment-808677959 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=h1) Report > Merging [#2731](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=desc) (a3fc957) into

[jira] [Commented] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-27 Thread Aditya Tiwari (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309899#comment-17309899 ] Aditya Tiwari commented on HUDI-1716: - I would like to pick this up. Kindly add me as a contributor. 

[jira] [Created] (HUDI-1729) Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread Danny Chen (Jira)
Danny Chen created HUDI-1729: Summary: Asynchronous Hive sync and commits cleaning for Flink writer Key: HUDI-1729 URL: https://issues.apache.org/jira/browse/HUDI-1729 Project: Apache Hudi

[GitHub] [hudi] n3nash opened a new pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
n3nash opened a new pull request #2731: URL: https://github.com/apache/hudi/pull/2731 ## Brief change log *Fixed Method Not Found for HiveMetastoreBasedLockProvider* *Renamed configs to match with other configs* ## Verify this pull request *(Please pick either of the

[jira] [Updated] (HUDI-1728) Addressing ClassNotFound when using HiveMetastoreBasedLockProvider

2021-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1728: - Labels: pull-request-available (was: ) > Addressing ClassNotFound when using

[GitHub] [hudi] codecov-io edited a comment on pull request #2729: [DO NOT MERGE] Verify IT scala2.12

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2729: URL: https://github.com/apache/hudi/pull/2729#issuecomment-808659555 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=h1) Report > Merging [#2729](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=desc) (e8805b8) into

[jira] [Updated] (HUDI-1729) Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1729: - Labels: pull-request-available (was: ) > Asynchronous Hive sync and commits cleaning for Flink

[GitHub] [hudi] danny0405 opened a new pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
danny0405 opened a new pull request #2732: URL: https://github.com/apache/hudi/pull/2732 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] codecov-io edited a comment on pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2731: URL: https://github.com/apache/hudi/pull/2731#issuecomment-808677959 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=h1) Report > Merging [#2731](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=desc) (7574bc2) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808716532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [hudi] danny0405 closed pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
danny0405 closed pull request #2732: URL: https://github.com/apache/hudi/pull/2732 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-io edited a comment on pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2731: URL: https://github.com/apache/hudi/pull/2731#issuecomment-808677959 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=h1) Report > Merging [#2731](https://codecov.io/gh/apache/hudi/pull/2731?src=pr=desc) (34d1f05) into

[GitHub] [hudi] nsivabalan commented on a change in pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
nsivabalan commented on a change in pull request #2731: URL: https://github.com/apache/hudi/pull/2731#discussion_r602729215 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java ## @@ -108,7 +108,7 @@ public static

[GitHub] [hudi] pengzhiwei2018 commented on pull request #2651: [HUDI-1591] [RFC-26] Improve Hoodie Table Query Performance And Ease Of Use Fo…

2021-03-27 Thread GitBox
pengzhiwei2018 commented on pull request #2651: URL: https://github.com/apache/hudi/pull/2651#issuecomment-808734748 > CatalogFileIndex Hi @umehrot2 I have test query the hive table, the `CatalogFileIndex` can really do the partition prune. But the data source table is not work

[GitHub] [hudi] n3nash commented on a change in pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
n3nash commented on a change in pull request #2731: URL: https://github.com/apache/hudi/pull/2731#discussion_r602734627 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java ## @@ -108,7 +108,7 @@ public static final

[GitHub] [hudi] codecov-io edited a comment on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808716532 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=h1) Report > Merging [#2732](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=desc) (03d16ef) into

[GitHub] [hudi] codecov-io commented on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
codecov-io commented on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808716532 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=h1) Report > Merging [#2732](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=desc) (03d16ef) into

[GitHub] [hudi] danny0405 commented on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
danny0405 commented on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808752624 Close and reopen to re-trigger the tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] codecov-io edited a comment on pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2731: URL: https://github.com/apache/hudi/pull/2731#issuecomment-808677959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[hudi] branch master updated: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks (#2731)

2021-03-27 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new bec7041 [HUDI-1728] Fix MethodNotFound for

[GitHub] [hudi] codecov-io edited a comment on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808716532 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=h1) Report > Merging [#2732](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=desc) (03d16ef) into

[GitHub] [hudi] n3nash merged pull request #2731: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks

2021-03-27 Thread GitBox
n3nash merged pull request #2731: URL: https://github.com/apache/hudi/pull/2731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch release-0.8.0 updated: [HUDI-1728] Fix MethodNotFound for HiveMetastore Locks (#2731)

2021-03-27 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch release-0.8.0 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.8.0 by this push: new b7c47b1 [HUDI-1728] Fix

[GitHub] [hudi] nsivabalan commented on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-27 Thread GitBox
nsivabalan commented on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-808810711 I assume you are using AvroKafkaSource. IIUC reading from kafka does not need a schema provider. Have you tried not setting any schema provider? -- This is an automated message

[GitHub] [hudi] nsivabalan edited a comment on issue #2589: [SUPPORT] Issue with adding column while running deltastreamer with kafka source.

2021-03-27 Thread GitBox
nsivabalan edited a comment on issue #2589: URL: https://github.com/apache/hudi/issues/2589#issuecomment-808810711 I assume you are using AvroKafkaSource. IIUC, reading from kafka does not need a schema provider. Have you tried not setting any schema provider? -- This is an automated

[GitHub] [hudi] nsivabalan edited a comment on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-27 Thread GitBox
nsivabalan edited a comment on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-808828818 Yes, your approach should work. Only change is that, we might have to fix it where we generate avro schema from df schema in HoodieSparkSqlWriter. Eg:

[GitHub] [hudi] nsivabalan commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-27 Thread GitBox
nsivabalan commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-808828818 Yes, your approach should work. Only change is that, we might have to fix it where we generate avro schema from df schema in HoodieSparkSqlWriter. Eg:

[jira] [Commented] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310101#comment-17310101 ] sivabalan narayanan commented on HUDI-1716: --- Sure. Feel free to take take it up.      > rt

[GitHub] [hudi] codecov-io edited a comment on pull request #2730: [DO NOT MERGE]Verify IT spark3

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2730: URL: https://github.com/apache/hudi/pull/2730#issuecomment-808660342 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2730?src=pr=h1) Report > Merging [#2730](https://codecov.io/gh/apache/hudi/pull/2730?src=pr=desc) (cae623b) into

[GitHub] [hudi] aditiwari01 commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-27 Thread GitBox
aditiwari01 commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-808839630 Yes. My changes are also in HoodieSparkSqlWriter where we generate avro schema from df schema. The only difference is where to keep the convertor function. Instead of having a

[GitHub] [hudi] codecov-io edited a comment on pull request #2732: [HUDI-1729] Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2732: URL: https://github.com/apache/hudi/pull/2732#issuecomment-808716532 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=h1) Report > Merging [#2732](https://codecov.io/gh/apache/hudi/pull/2732?src=pr=desc) (b65) into

[jira] [Created] (HUDI-1730) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-27 Thread Leo Zhu (Jira)
Leo Zhu created HUDI-1730: - Summary: Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other Key: HUDI-1730 URL: https://issues.apache.org/jira/browse/HUDI-1730

[GitHub] [hudi] codecov-io edited a comment on pull request #2729: [DO NOT MERGE] Verify IT scala2.12

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2729: URL: https://github.com/apache/hudi/pull/2729#issuecomment-808659555 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=h1) Report > Merging [#2729](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=desc) (5d06eda) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2730: [DO NOT MERGE]Verify IT spark3

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2730: URL: https://github.com/apache/hudi/pull/2730#issuecomment-808660342 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2730?src=pr=h1) Report > Merging [#2730](https://codecov.io/gh/apache/hudi/pull/2730?src=pr=desc) (25a22a1) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2730: [DO NOT MERGE]Verify IT spark3

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2730: URL: https://github.com/apache/hudi/pull/2730#issuecomment-808660342 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [hudi] codecov-io edited a comment on pull request #2729: [DO NOT MERGE] Verify IT scala2.12

2021-03-27 Thread GitBox
codecov-io edited a comment on pull request #2729: URL: https://github.com/apache/hudi/pull/2729#issuecomment-808659555 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=h1) Report > Merging [#2729](https://codecov.io/gh/apache/hudi/pull/2729?src=pr=desc) (5d06eda) into

[jira] [Created] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-27 Thread Leo Zhu (Jira)
Leo Zhu created HUDI-1731: - Summary: Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other Key: HUDI-1731 URL: https://issues.apache.org/jira/browse/HUDI-1731